![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9238 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9108 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30032 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37181 originally caused by: Started by upstream project "master-osmo-iuh" build number 12846 originally caused by: Started by upstream project "master-libasn1c" build number 1805 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37182 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9108 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29257 originally caused by: Started by upstream project "master-osmo-msc" build number 34200 originally caused by: Started by upstream project "master-osmo-iuh" build number 12846 originally caused by: Started by upstream project "master-libasn1c" build number 1805 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34201 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9108 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17651 originally caused by: Started by upstream project "master-osmo-bsc" build number 20105 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9108 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12965 originally caused by: Started by upstream project "master-openbsc" build number 13161 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9108 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30033 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37183 originally caused by: Started by upstream project "master-osmo-iuh" build number 12847 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9108 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29258 originally caused by: Started by upstream project "master-osmo-msc" build number 34202 originally caused by: Started by upstream project "master-osmo-iuh" build number 12847 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9108 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17652 originally caused by: Started by upstream project "master-osmo-bsc" build number 20106 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17652 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6677 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8942 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2946 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29258 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5149 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30033 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9238 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5188 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3906 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins15925213184195843855.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 08:22:30 + trial_dir_prefix=trial- + rm -rf trial-2356 trial-2356-bin.tgz trial-2356-run.tgz + trial_dir=trial-2357 + mkdir -p trial-2357 + mv open5gs.build-8.tgz osmo-bsc.build-17652.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2946.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29258.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3906.tgz osmo-pcu-sysmo.build-5188.tgz osmo-pcu.build-5149.tgz osmo-sgsn.build-30033.tgz osmo-stp.build-9238.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz trial-2357 + cat open5gs.build-8.md5 osmo-bsc.build-17652.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2946.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29258.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3906.md5 osmo-pcu-sysmo.build-5188.md5 osmo-pcu.build-5149.md5 osmo-sgsn.build-30033.md5 osmo-stp.build-9238.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17652.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2946.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29258.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3906.md5 osmo-pcu-sysmo.build-5188.md5 osmo-pcu.build-5149.md5 osmo-sgsn.build-30033.md5 osmo-stp.build-9238.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2357 combinations: None trial: 'trial-2357' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2357 -------------------------------------------------------------------------------------------- 08:22:41.740270 tst trial-2357: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/log --------------------------------------------------------------------- trial-2357 nitb_sms:sysmo --------------------------------------------------------------------- 08:24:52.955603 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:24:52.960280 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 08:24:52.983080 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 08:24:52.990870 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 08:24:53.046735 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 08:24:53.068574 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 08:24:53.076303 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 08:24:53.613761 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:24:53.618734 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 08:24:53.629885 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 08:24:54.016141 tst mo_mt_sms.py: using LAC 20181 08:24:54.256401 tst mo_mt_sms.py: using RAC 36 08:24:54.374726 tst mo_mt_sms.py: using CellId 20181 08:24:54.495260 tst mo_mt_sms.py: using BVCI 20182 08:24:54.605238 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:24:54.783884 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:24:54.898086 tst mo_mt_sms.py:9: start nitb and bts... 08:24:55.090551 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:24:57.277680 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13235): Launched 08:24:57.572280 run osmo-nitb_10.42.42.2(pid=13236): Launched 08:24:57.733451 run osmo-nitb_10.42.42.2(pid=13236): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13236)] 08:24:57.855025 run osmo-nitb_10.42.42.2(pid=13236): stdout: | (launched: 2022-12-09_08:24:57.518150) 08:24:57.977381 run osmo-nitb_10.42.42.2(pid=13236): stderr: | (launched: 2022-12-09_08:24:57.562571) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:24:58.100375 run osmo-nitb_10.42.42.2(pid=13236): stdout: | (launched: 2022-12-09_08:24:57.518150) 08:24:58.217417 run osmo-nitb_10.42.42.2(pid=13236): stderr: | (launched: 2022-12-09_08:24:57.562571) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:24:58.358007 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13236): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13236) [trial-2357↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13236)] [trial-2357↪nitb_sms:sysmo↪mo_mt_sms.py:11] 08:24:58.366064 tst mo_mt_sms.py:11: Test FAILED (4.7 sec) 08:24:58.372444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13235): Terminating (SIGTERM) 08:24:58.581115 --- ParallelTerminationStrategy: PID 13235 died... 08:24:58.601346 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13235): Terminated: ok {rc=0} 08:24:58.684481 bus /sierra_3: Setting Powered False 08:24:59.783281 bus /sierra_3: Setting Powered False 08:25:00.914233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:sysmo --------------------------------------------------------------------- 08:25:02.105108 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:25:02.112393 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 08:25:02.145605 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 08:25:02.185898 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 08:25:02.247844 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 08:25:02.270491 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 08:25:02.301590 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 08:25:02.848517 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:25:02.853770 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:25:02.864833 tst sms:sysmo: Using 1 x bts (candidates: 1) 08:25:02.903813 tst mo_mt_sms.py: using LAC 20182 08:25:03.029412 tst mo_mt_sms.py: using RAC 37 08:25:03.151670 tst mo_mt_sms.py: using CellId 20182 08:25:03.276150 tst mo_mt_sms.py: using BVCI 20183 08:25:03.391978 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:25:03.402920 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:25:03.413917 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:25:03.425058 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:25:03.436180 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:25:03.447244 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:25:03.566832 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:25:03.690528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:05.423757 run create_hlr_db(pid=13244): Launched 08:25:05.544297 bus /sierra_2: Setting Powered False 08:25:06.607547 run create_hlr_db(pid=13244): Terminated: ok {rc=0} 08:25:07.028719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13246): Launched 08:25:07.324053 run osmo-hlr_10.42.42.2(pid=13247): Launched 08:25:07.437503 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:09.856232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13249): Launched 08:25:10.150575 run osmo-stp_10.42.42.5(pid=13250): Launched 08:25:10.262097 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:15.441570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13252): Launched 08:25:15.734351 run osmo-msc_10.42.42.6(pid=13253): Launched 08:25:15.998993 run osmo-stp_10.42.42.5(pid=13250): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13250)] 08:25:16.142567 run osmo-stp_10.42.42.5(pid=13250): stdout: | (launched: 2022-12-09_08:25:10.096701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:16.388410 run osmo-stp_10.42.42.5(pid=13250): stderr: | [0;m[38;5;43m20221209082510263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082510263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082510263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082510264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082510264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082510264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082510265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:16.517390 run osmo-stp_10.42.42.5(pid=13250): stdout: | (launched: 2022-12-09_08:25:10.096701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:16.639939 run osmo-stp_10.42.42.5(pid=13250): stderr: | [0;m[38;5;43m20221209082510263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082510263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082510263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082510264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082510264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082510264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082510265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:16.783162 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13250): Process ended prematurely: osmo-stp_10.42.42.5(pid=13250) [trial-2357↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13250)] [trial-2357↪sms:sysmo↪mo_mt_sms.py:16] 08:25:16.792360 tst mo_mt_sms.py:16: Test FAILED (13.9 sec) 08:25:16.819436 run osmo-hlr_10.42.42.2(pid=13247): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13247)] 08:25:16.868360 run osmo-hlr_10.42.42.2(pid=13247): stdout: | (launched: 2022-12-09_08:25:07.269882) 08:25:16.918329 run osmo-hlr_10.42.42.2(pid=13247): stderr: | [0;m[1;31m20221209082507442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082507442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082507442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082507442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082507442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082507442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082507459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082507469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082507469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082507469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:16.987516 run osmo-msc_10.42.42.6(pid=13253): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13253)] 08:25:17.036431 run osmo-msc_10.42.42.6(pid=13253): stdout: | (launched: 2022-12-09_08:25:15.680710) 08:25:17.086197 run osmo-msc_10.42.42.6(pid=13253): stderr: | [0;m[38;5;43m20221209082516030 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082516030 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f05cdcecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082516031 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082516031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082516037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082516037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082516039 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082516039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082516039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082516039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:17.136653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13246): Terminating (SIGTERM) 08:25:17.181637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13249): Terminating (SIGTERM) 08:25:17.222433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13252): Terminating (SIGTERM) 08:25:17.263208 --- ParallelTerminationStrategy: PID 13246 died... 08:25:17.282352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13246): Terminated: ok {rc=0} 08:25:17.327856 --- ParallelTerminationStrategy: PID 13249 died... 08:25:17.346938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13249): Terminated: ok {rc=0} 08:25:17.391652 --- ParallelTerminationStrategy: PID 13252 died... 08:25:17.410688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13252): Terminated: ok {rc=0} 08:25:17.495616 bus /sierra_3: Setting Powered False 08:25:18.594053 bus /sierra_3: Setting Powered False 08:25:19.712211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:sysmo --------------------------------------------------------------------- 08:25:20.927921 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:25:20.931428 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:25:20.952432 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 08:25:20.959250 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:25:20.993520 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:25:21.015254 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 08:25:21.023001 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:25:21.541916 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 08:25:21.548262 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 08:25:21.560490 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 08:25:21.597359 tst assert_extension.py: using LAC 20183 08:25:21.721838 tst assert_extension.py: using RAC 38 08:25:21.852028 tst assert_extension.py: using CellId 20183 08:25:21.976307 tst assert_extension.py: using BVCI 20184 08:25:22.083918 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 08:25:22.200613 tst assert_extension.py:10: start nitb and bts... 08:25:22.414680 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:25:23.058302 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13259): Launched 08:25:23.373754 run osmo-nitb_10.42.42.2(pid=13260): Launched 08:25:23.548450 run osmo-nitb_10.42.42.2(pid=13260): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13260)] 08:25:23.689601 run osmo-nitb_10.42.42.2(pid=13260): stdout: | (launched: 2022-12-09_08:25:23.316649) 08:25:23.832710 run osmo-nitb_10.42.42.2(pid=13260): stderr: | (launched: 2022-12-09_08:25:23.363800) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:25:23.975438 run osmo-nitb_10.42.42.2(pid=13260): stdout: | (launched: 2022-12-09_08:25:23.316649) 08:25:24.114575 run osmo-nitb_10.42.42.2(pid=13260): stderr: | (launched: 2022-12-09_08:25:23.363800) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13260): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13260) [trial-2357↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13260)] 08:25:24.493245 tst osmo-nitb_10.42.42.2(pid=13260): stdout: | (launched: 2022-12-09_08:25:23.316649) 08:25:24.621101 tst osmo-nitb_10.42.42.2(pid=13260): stderr: | (launched: 2022-12-09_08:25:23.363800) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:25:24.771807 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13260): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13260) [trial-2357↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13260)] [trial-2357↪nitb_ussd:sysmo↪assert_extension.py:12] 08:25:24.780799 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:25:24.787764 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13259): Terminating (SIGTERM) 08:25:24.998903 --- ParallelTerminationStrategy: PID 13259 died... 08:25:25.020317 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13259): Terminated: ok {rc=0} 08:25:25.108041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:sysmo --------------------------------------------------------------------- 08:25:26.272415 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:25:26.276014 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:25:26.297178 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 08:25:26.324293 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:25:26.359087 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:25:26.379762 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 08:25:26.406437 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:25:26.936425 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:sysmo assert_extension.py ---------------------------------------------- 08:25:26.941697 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:25:26.952239 tst ussd:sysmo: Using 1 x bts (candidates: 1) 08:25:26.986270 tst assert_extension.py: using LAC 20184 08:25:27.104631 tst assert_extension.py: using RAC 39 08:25:27.220334 tst assert_extension.py: using CellId 20184 08:25:27.336212 tst assert_extension.py: using BVCI 20185 08:25:27.442787 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:25:27.453513 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:25:27.463949 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:25:27.474488 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:25:27.484886 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:25:27.495379 tst ussd:sysmo: Using 1 x modem (candidates: 1) 08:25:27.611657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:28.102786 run create_hlr_db(pid=13264): Launched 08:25:28.223897 bus /sierra_2: Setting Powered False 08:25:29.286668 run create_hlr_db(pid=13264): Terminated: ok {rc=0} 08:25:29.735460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13266): Launched 08:25:30.051819 run osmo-hlr_10.42.42.2(pid=13267): Launched 08:25:30.172806 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:30.722340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13269): Launched 08:25:31.049718 run osmo-stp_10.42.42.5(pid=13270): Launched 08:25:31.304397 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:32.051376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13272): Launched 08:25:32.370121 run osmo-msc_10.42.42.6(pid=13273): Launched 08:25:32.539941 run osmo-stp_10.42.42.5(pid=13270): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13270)] 08:25:32.669765 run osmo-stp_10.42.42.5(pid=13270): stdout: | (launched: 2022-12-09_08:25:30.983655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:32.797957 run osmo-stp_10.42.42.5(pid=13270): stderr: | [0;m[38;5;43m20221209082531423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082531423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082531425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082531427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082531431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082531432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082531432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:32.924134 run osmo-stp_10.42.42.5(pid=13270): stdout: | (launched: 2022-12-09_08:25:30.983655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:33.045145 run osmo-stp_10.42.42.5(pid=13270): stderr: | [0;m[38;5;43m20221209082531423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082531423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082531425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082531427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082531431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082531432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082531432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:33.188856 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13270): Process ended prematurely: osmo-stp_10.42.42.5(pid=13270) [trial-2357↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13270)] [trial-2357↪ussd:sysmo↪assert_extension.py:17] 08:25:33.197331 tst assert_extension.py:17: Test FAILED (6.2 sec) 08:25:33.223711 run osmo-hlr_10.42.42.2(pid=13267): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13267)] 08:25:33.273312 run osmo-hlr_10.42.42.2(pid=13267): stdout: | (launched: 2022-12-09_08:25:29.994384) 08:25:33.323870 run osmo-hlr_10.42.42.2(pid=13267): stderr: | [0;m[1;31m20221209082530187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082530187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082530187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082530187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082530187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082530187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082530207 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082530215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082530215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082530215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:33.393804 run osmo-msc_10.42.42.6(pid=13273): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13273)] 08:25:33.442610 run osmo-msc_10.42.42.6(pid=13273): stdout: | (launched: 2022-12-09_08:25:32.314879) 08:25:33.493136 run osmo-msc_10.42.42.6(pid=13273): stderr: | [0;m[38;5;43m20221209082532585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082532585 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1631e5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082532585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082532585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082532585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082532586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082532587 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082532588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082532588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082532588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:33.544013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13266): Terminating (SIGTERM) 08:25:33.584486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13269): Terminating (SIGTERM) 08:25:33.625046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13272): Terminating (SIGTERM) 08:25:33.666208 --- ParallelTerminationStrategy: PID 13266 died... 08:25:33.685374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13266): Terminated: ok {rc=0} 08:25:33.730701 --- ParallelTerminationStrategy: PID 13269 died... 08:25:33.749694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13269): Terminated: ok {rc=0} 08:25:33.795194 --- ParallelTerminationStrategy: PID 13272 died... 08:25:33.814584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13272): Terminated: ok {rc=0} 08:25:33.900506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:25:35.126138 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:25:35.133654 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:25:35.155294 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:25:35.183034 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:25:35.236326 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:25:35.258801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:25:35.287361 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:25:35.837334 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:25:35.889737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:35.901141 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:25:35.957295 tst mo_mt_call.py: using LAC 20185 08:25:36.077560 tst mo_mt_call.py: using RAC 40 08:25:36.201783 tst mo_mt_call.py: using CellId 20185 08:25:36.327081 tst mo_mt_call.py: using BVCI 20186 08:25:36.440022 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:36.451274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:36.462460 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:36.473972 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:36.485598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:36.497230 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:25:36.618062 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:25:36.736283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:37.245569 run create_hlr_db(pid=13278): Launched 08:25:37.372640 bus /sierra_2: Setting Powered False 08:25:38.437180 run create_hlr_db(pid=13278): Terminated: ok {rc=0} 08:25:38.874094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13280): Launched 08:25:39.179572 run osmo-hlr_10.42.42.2(pid=13281): Launched 08:25:39.296228 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:39.824091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13283): Launched 08:25:40.131131 run osmo-stp_10.42.42.5(pid=13284): Launched 08:25:40.248796 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:40.802147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13286): Launched 08:25:41.107397 run osmo-msc_10.42.42.6(pid=13287): Launched 08:25:41.278594 run osmo-stp_10.42.42.5(pid=13284): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13284)] 08:25:41.407999 run osmo-stp_10.42.42.5(pid=13284): stdout: | (launched: 2022-12-09_08:25:40.075462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:41.537190 run osmo-stp_10.42.42.5(pid=13284): stderr: | [0;m[38;5;43m20221209082540244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082540244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082540245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082540245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082540246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082540246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082540246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:41.664079 run osmo-stp_10.42.42.5(pid=13284): stdout: | (launched: 2022-12-09_08:25:40.075462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:41.785877 run osmo-stp_10.42.42.5(pid=13284): stderr: | [0;m[38;5;43m20221209082540244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082540244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082540245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082540245 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082540246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082540246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082540246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:41.936180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13284): Process ended prematurely: osmo-stp_10.42.42.5(pid=13284) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13284)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:25:41.945488 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:25:41.971643 run osmo-hlr_10.42.42.2(pid=13281): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13281)] 08:25:42.019286 run osmo-hlr_10.42.42.2(pid=13281): stdout: | (launched: 2022-12-09_08:25:39.124042) 08:25:42.069114 run osmo-hlr_10.42.42.2(pid=13281): stderr: | [0;m[1;31m20221209082539296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082539296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082539296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082539296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082539296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082539296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082539315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082539326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082539327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082539327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:42.138006 run osmo-msc_10.42.42.6(pid=13287): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13287)] 08:25:42.185642 run osmo-msc_10.42.42.6(pid=13287): stdout: | (launched: 2022-12-09_08:25:41.051013) 08:25:42.234775 run osmo-msc_10.42.42.6(pid=13287): stderr: | [0;m[38;5;43m20221209082541321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082541321 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4299a28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082541321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082541321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082541321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082541321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082541323 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082541323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082541324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082541324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:42.284302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13280): Terminating (SIGTERM) 08:25:42.323955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13283): Terminating (SIGTERM) 08:25:42.363663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13286): Terminating (SIGTERM) 08:25:42.403681 --- ParallelTerminationStrategy: PID 13280 died... 08:25:42.422669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13280): Terminated: ok {rc=0} 08:25:42.466104 --- ParallelTerminationStrategy: PID 13283 died... 08:25:42.484494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13283): Terminated: ok {rc=0} 08:25:42.528763 --- ParallelTerminationStrategy: PID 13286 died... 08:25:42.547240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13286): Terminated: ok {rc=0} 08:25:42.630820 bus /sierra_3: Setting Powered False 08:25:43.729538 bus /sierra_3: Setting Powered False 08:25:44.845532 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:25:46.003711 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:46.016474 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:25:46.075647 tst mo_mt_call_osmux.py: using LAC 20186 08:25:46.232606 tst mo_mt_call_osmux.py: using RAC 41 08:25:46.367049 tst mo_mt_call_osmux.py: using CellId 20186 08:25:46.498558 tst mo_mt_call_osmux.py: using BVCI 20187 08:25:46.640497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:46.654029 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:46.667975 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:46.682162 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:46.696303 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:25:46.710396 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:25:46.839567 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:25:46.981113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:47.494746 run create_hlr_db(pid=13289): Launched 08:25:47.622392 bus /sierra_2: Setting Powered False 08:25:48.684346 run create_hlr_db(pid=13289): Terminated: ok {rc=0} 08:25:49.130749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13291): Launched 08:25:49.461173 run osmo-hlr_10.42.42.2(pid=13292): Launched 08:25:49.589394 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:50.150896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13294): Launched 08:25:50.481685 run osmo-stp_10.42.42.5(pid=13295): Launched 08:25:50.610176 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:51.206025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13297): Launched 08:25:51.535037 run osmo-msc_10.42.42.6(pid=13298): Launched 08:25:51.719984 run osmo-stp_10.42.42.5(pid=13295): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13295)] 08:25:51.858641 run osmo-stp_10.42.42.5(pid=13295): stdout: | (launched: 2022-12-09_08:25:50.422351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:51.998178 run osmo-stp_10.42.42.5(pid=13295): stderr: | [0;m[38;5;43m20221209082550613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082550613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082550614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082550614 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082550614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082550615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082550615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:52.135479 run osmo-stp_10.42.42.5(pid=13295): stdout: | (launched: 2022-12-09_08:25:50.422351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:52.267591 run osmo-stp_10.42.42.5(pid=13295): stderr: | [0;m[38;5;43m20221209082550613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082550613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082550614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082550614 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082550614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082550615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082550615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:52.425079 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13295): Process ended prematurely: osmo-stp_10.42.42.5(pid=13295) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13295)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:25:52.434744 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:25:52.462876 run osmo-hlr_10.42.42.2(pid=13292): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13292)] 08:25:52.514320 run osmo-hlr_10.42.42.2(pid=13292): stdout: | (launched: 2022-12-09_08:25:49.401810) 08:25:52.566765 run osmo-hlr_10.42.42.2(pid=13292): stderr: | [0;m[1;31m20221209082549598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082549598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082549598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082549598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082549598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082549598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082549610 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082549619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082549620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082549620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:52.640192 run osmo-msc_10.42.42.6(pid=13298): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13298)] 08:25:52.691104 run osmo-msc_10.42.42.6(pid=13298): stdout: | (launched: 2022-12-09_08:25:51.475494) 08:25:52.743859 run osmo-msc_10.42.42.6(pid=13298): stderr: | [0;m[38;5;43m20221209082551797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082551797 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc271753c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082551797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082551797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082551798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082551798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082551799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082551800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082551800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082551800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:52.796524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13291): Terminating (SIGTERM) 08:25:52.838569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13294): Terminating (SIGTERM) 08:25:52.880914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13297): Terminating (SIGTERM) 08:25:52.923375 --- ParallelTerminationStrategy: PID 13291 died... 08:25:52.943588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13291): Terminated: ok {rc=0} 08:25:52.990629 --- ParallelTerminationStrategy: PID 13294 died... 08:25:53.010433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13294): Terminated: ok {rc=0} 08:25:53.057028 --- ParallelTerminationStrategy: PID 13297 died... 08:25:53.076646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13297): Terminated: ok {rc=0} 08:25:53.164717 bus /sierra_3: Setting Powered False 08:25:54.265177 bus /sierra_3: Setting Powered False 08:25:55.380699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:25:56.621407 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:25:56.628096 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:25:56.652052 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:25:56.680789 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:25:56.733914 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:25:56.755680 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:25:56.783767 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:25:57.337966 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:25:57.394681 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:25:57.406588 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:25:57.466532 tst mo_mt_call.py: using LAC 20187 08:25:57.596918 tst mo_mt_call.py: using RAC 42 08:25:57.724871 tst mo_mt_call.py: using CellId 20187 08:25:57.857228 tst mo_mt_call.py: using BVCI 20188 08:25:57.977886 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:25:57.989675 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:25:58.001429 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:25:58.013305 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:25:58.025335 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:25:58.037295 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:25:58.154643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:25:58.273986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:58.783401 run create_hlr_db(pid=13303): Launched 08:25:58.907657 bus /sierra_2: Setting Powered False 08:25:59.972676 run create_hlr_db(pid=13303): Terminated: ok {rc=0} 08:26:00.413015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13305): Launched 08:26:00.719085 run osmo-hlr_10.42.42.2(pid=13306): Launched 08:26:00.835903 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:01.522108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13308): Launched 08:26:01.851628 run osmo-stp_10.42.42.5(pid=13309): Launched 08:26:02.083539 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:02.731629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13311): Launched 08:26:03.059123 run osmo-msc_10.42.42.6(pid=13312): Launched 08:26:03.243762 run osmo-stp_10.42.42.5(pid=13309): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13309)] 08:26:03.382795 run osmo-stp_10.42.42.5(pid=13309): stdout: | (launched: 2022-12-09_08:26:01.795044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:03.521444 run osmo-stp_10.42.42.5(pid=13309): stderr: | [0;m[38;5;43m20221209082601975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082601975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082601975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082601976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082601976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082601976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082601976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:03.658608 run osmo-stp_10.42.42.5(pid=13309): stdout: | (launched: 2022-12-09_08:26:01.795044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:03.790143 run osmo-stp_10.42.42.5(pid=13309): stderr: | [0;m[38;5;43m20221209082601975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082601975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082601975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082601976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082601976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082601976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082601976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:03.946998 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13309): Process ended prematurely: osmo-stp_10.42.42.5(pid=13309) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13309)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:26:03.956617 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:26:03.984649 run osmo-hlr_10.42.42.2(pid=13306): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13306)] 08:26:04.035497 run osmo-hlr_10.42.42.2(pid=13306): stdout: | (launched: 2022-12-09_08:26:00.663567) 08:26:04.088007 run osmo-hlr_10.42.42.2(pid=13306): stderr: | [0;m[1;31m20221209082600856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082600856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082600856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082600865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082600865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082600865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082600883 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082600903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082600903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082600904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:04.160242 run osmo-msc_10.42.42.6(pid=13312): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13312)] 08:26:04.210608 run osmo-msc_10.42.42.6(pid=13312): stdout: | (launched: 2022-12-09_08:26:02.999831) 08:26:04.262692 run osmo-msc_10.42.42.6(pid=13312): stderr: | [0;m[38;5;43m20221209082603319 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082603319 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f32ac813c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082603320 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082603320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082603320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082603320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082603322 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082603322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082603322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082603322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:04.315466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13305): Terminating (SIGTERM) 08:26:04.357402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13308): Terminating (SIGTERM) 08:26:04.399604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13311): Terminating (SIGTERM) 08:26:04.441997 --- ParallelTerminationStrategy: PID 13305 died... 08:26:04.462011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13305): Terminated: ok {rc=0} 08:26:04.508814 --- ParallelTerminationStrategy: PID 13308 died... 08:26:04.528747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13308): Terminated: ok {rc=0} 08:26:04.575607 --- ParallelTerminationStrategy: PID 13311 died... 08:26:04.595276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13311): Terminated: ok {rc=0} 08:26:04.684480 bus /sierra_3: Setting Powered False 08:26:05.783552 bus /sierra_3: Setting Powered False 08:26:06.900363 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:26:08.045880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:26:08.057741 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:26:08.115350 tst mo_mt_call_osmux.py: using LAC 20188 08:26:08.235677 tst mo_mt_call_osmux.py: using RAC 43 08:26:08.366360 tst mo_mt_call_osmux.py: using CellId 20188 08:26:08.496152 tst mo_mt_call_osmux.py: using BVCI 20189 08:26:08.617115 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:26:08.628804 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:26:08.640434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:26:08.652315 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:26:08.664154 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:26:08.675945 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:26:08.795923 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:26:08.919828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:09.431134 run create_hlr_db(pid=13314): Launched 08:26:09.556257 bus /sierra_2: Setting Powered False 08:26:10.620275 run create_hlr_db(pid=13314): Terminated: ok {rc=0} 08:26:11.058424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13316): Launched 08:26:11.365239 run osmo-hlr_10.42.42.2(pid=13317): Launched 08:26:11.482237 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:12.010388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13319): Launched 08:26:12.316782 run osmo-stp_10.42.42.5(pid=13320): Launched 08:26:12.434106 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:12.987549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13322): Launched 08:26:13.293481 run osmo-msc_10.42.42.6(pid=13323): Launched 08:26:13.464415 run osmo-stp_10.42.42.5(pid=13320): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13320)] 08:26:13.593335 run osmo-stp_10.42.42.5(pid=13320): stdout: | (launched: 2022-12-09_08:26:12.261066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:13.722309 run osmo-stp_10.42.42.5(pid=13320): stderr: | [0;m[38;5;43m20221209082612429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082612429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082612429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082612430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082612430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082612430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082612430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:13.849453 run osmo-stp_10.42.42.5(pid=13320): stdout: | (launched: 2022-12-09_08:26:12.261066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:13.971474 run osmo-stp_10.42.42.5(pid=13320): stderr: | [0;m[38;5;43m20221209082612429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082612429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082612429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082612430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082612430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082612430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082612430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:14.117178 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13320): Process ended prematurely: osmo-stp_10.42.42.5(pid=13320) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13320)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:26:14.126430 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:26:14.152707 run osmo-hlr_10.42.42.2(pid=13317): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13317)] 08:26:14.200600 run osmo-hlr_10.42.42.2(pid=13317): stdout: | (launched: 2022-12-09_08:26:11.309310) 08:26:14.250036 run osmo-hlr_10.42.42.2(pid=13317): stderr: | [0;m[1;31m20221209082611482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082611482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082611482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082611482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082611482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082611482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082611498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082611508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082611508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082611508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:14.318884 run osmo-msc_10.42.42.6(pid=13323): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13323)] 08:26:14.366537 run osmo-msc_10.42.42.6(pid=13323): stdout: | (launched: 2022-12-09_08:26:13.237579) 08:26:14.415814 run osmo-msc_10.42.42.6(pid=13323): stderr: | [0;m[38;5;43m20221209082613505 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082613505 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2327b95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082613505 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082613506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082613506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082613506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082613508 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082613508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082613508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082613508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:14.465432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13316): Terminating (SIGTERM) 08:26:14.504928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13319): Terminating (SIGTERM) 08:26:14.544455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13322): Terminating (SIGTERM) 08:26:14.584270 --- ParallelTerminationStrategy: PID 13316 died... 08:26:14.603357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13316): Terminated: ok {rc=0} 08:26:14.647281 --- ParallelTerminationStrategy: PID 13319 died... 08:26:14.665904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13319): Terminated: ok {rc=0} 08:26:14.709722 --- ParallelTerminationStrategy: PID 13322 died... 08:26:14.728308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13322): Terminated: ok {rc=0} 08:26:14.814422 bus /sierra_3: Setting Powered False 08:26:15.925905 bus /sierra_3: Setting Powered False 08:26:17.057594 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:26:18.302043 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:26:18.309710 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:26:18.331513 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:26:18.360374 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:26:18.417191 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:26:18.439757 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:26:18.468549 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:26:19.022057 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:26:19.077582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:19.089486 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:26:19.146663 tst mo_mt_call.py: using LAC 20189 08:26:19.272926 tst mo_mt_call.py: using RAC 44 08:26:19.400871 tst mo_mt_call.py: using CellId 20189 08:26:19.528175 tst mo_mt_call.py: using BVCI 20190 08:26:19.647341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:19.659136 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:19.670659 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:19.682596 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:19.694704 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:19.707135 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:26:19.830244 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:26:19.948032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:20.426107 run create_hlr_db(pid=13328): Launched 08:26:20.553161 bus /sierra_2: Setting Powered False 08:26:21.614431 run create_hlr_db(pid=13328): Terminated: ok {rc=0} 08:26:22.039841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13330): Launched 08:26:22.347997 run osmo-hlr_10.42.42.2(pid=13331): Launched 08:26:22.464834 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:23.009541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13333): Launched 08:26:23.314971 run osmo-stp_10.42.42.5(pid=13334): Launched 08:26:23.431901 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:23.985106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13336): Launched 08:26:24.292645 run osmo-msc_10.42.42.6(pid=13337): Launched 08:26:24.465201 run osmo-stp_10.42.42.5(pid=13334): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13334)] 08:26:24.594212 run osmo-stp_10.42.42.5(pid=13334): stdout: | (launched: 2022-12-09_08:26:23.259286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:24.723203 run osmo-stp_10.42.42.5(pid=13334): stderr: | [0;m[38;5;43m20221209082623426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082623426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082623427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082623427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082623427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082623428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082623428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:24.850900 run osmo-stp_10.42.42.5(pid=13334): stdout: | (launched: 2022-12-09_08:26:23.259286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:24.973137 run osmo-stp_10.42.42.5(pid=13334): stderr: | [0;m[38;5;43m20221209082623426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082623426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082623427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082623427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082623427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082623428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082623428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:25.119702 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13334): Process ended prematurely: osmo-stp_10.42.42.5(pid=13334) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13334)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:26:25.128418 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:26:25.154539 run osmo-hlr_10.42.42.2(pid=13331): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13331)] 08:26:25.202192 run osmo-hlr_10.42.42.2(pid=13331): stdout: | (launched: 2022-12-09_08:26:22.291854) 08:26:25.251418 run osmo-hlr_10.42.42.2(pid=13331): stderr: | [0;m[1;31m20221209082622466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082622466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082622466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082622466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082622466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082622467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082622479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082622487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082622487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082622487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:25.320137 run osmo-msc_10.42.42.6(pid=13337): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13337)] 08:26:25.367972 run osmo-msc_10.42.42.6(pid=13337): stdout: | (launched: 2022-12-09_08:26:24.236705) 08:26:25.417272 run osmo-msc_10.42.42.6(pid=13337): stderr: | [0;m[38;5;43m20221209082624504 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082624504 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ac4c01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082624504 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082624504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082624505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082624505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082624507 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082624507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082624507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082624507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:25.466942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13330): Terminating (SIGTERM) 08:26:25.506291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13333): Terminating (SIGTERM) 08:26:25.545808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13336): Terminating (SIGTERM) 08:26:25.585558 --- ParallelTerminationStrategy: PID 13330 died... 08:26:25.604437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13330): Terminated: ok {rc=0} 08:26:25.648040 --- ParallelTerminationStrategy: PID 13333 died... 08:26:25.666677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13333): Terminated: ok {rc=0} 08:26:25.710668 --- ParallelTerminationStrategy: PID 13336 died... 08:26:25.729305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13336): Terminated: ok {rc=0} 08:26:25.815694 bus /sierra_3: Setting Powered False 08:26:26.916213 bus /sierra_3: Setting Powered False 08:26:28.032271 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:26:29.179638 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:29.191654 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:26:29.248858 tst mo_mt_call_osmux.py: using LAC 20190 08:26:29.370752 tst mo_mt_call_osmux.py: using RAC 45 08:26:29.492686 tst mo_mt_call_osmux.py: using CellId 20190 08:26:29.614454 tst mo_mt_call_osmux.py: using BVCI 20191 08:26:29.725859 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:29.737162 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:29.748310 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:29.759534 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:29.770723 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:26:29.782011 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:26:29.898872 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:26:30.014633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:30.492882 run create_hlr_db(pid=13339): Launched 08:26:30.618598 bus /sierra_2: Setting Powered False 08:26:31.691046 run create_hlr_db(pid=13339): Terminated: ok {rc=0} 08:26:32.129366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13341): Launched 08:26:32.451513 run osmo-hlr_10.42.42.2(pid=13342): Launched 08:26:32.569564 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:33.097986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13344): Launched 08:26:33.405638 run osmo-stp_10.42.42.5(pid=13345): Launched 08:26:33.522177 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:34.076480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Launched 08:26:34.385244 run osmo-msc_10.42.42.6(pid=13348): Launched 08:26:34.558028 run osmo-stp_10.42.42.5(pid=13345): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13345)] 08:26:34.687834 run osmo-stp_10.42.42.5(pid=13345): stdout: | (launched: 2022-12-09_08:26:33.349634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:34.817822 run osmo-stp_10.42.42.5(pid=13345): stderr: | [0;m[38;5;43m20221209082633518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082633518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082633518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082633519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082633519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082633519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082633519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:34.945453 run osmo-stp_10.42.42.5(pid=13345): stdout: | (launched: 2022-12-09_08:26:33.349634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:35.067908 run osmo-stp_10.42.42.5(pid=13345): stderr: | [0;m[38;5;43m20221209082633518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082633518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082633518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082633519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082633519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082633519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082633519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:35.214696 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13345): Process ended prematurely: osmo-stp_10.42.42.5(pid=13345) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13345)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:26:35.223558 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:26:35.249631 run osmo-hlr_10.42.42.2(pid=13342): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13342)] 08:26:35.297293 run osmo-hlr_10.42.42.2(pid=13342): stdout: | (launched: 2022-12-09_08:26:32.395337) 08:26:35.346437 run osmo-hlr_10.42.42.2(pid=13342): stderr: | [0;m[1;31m20221209082632571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082632571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082632571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082632571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082632571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082632571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082632608 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082632617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082632618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082632618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:35.414891 run osmo-msc_10.42.42.6(pid=13348): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13348)] 08:26:35.462657 run osmo-msc_10.42.42.6(pid=13348): stdout: | (launched: 2022-12-09_08:26:34.329311) 08:26:35.511957 run osmo-msc_10.42.42.6(pid=13348): stderr: | [0;m[38;5;43m20221209082634597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082634598 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61c6ff1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082634598 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082634598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082634598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082634598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082634600 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082634600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082634601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082634601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:35.562131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13341): Terminating (SIGTERM) 08:26:35.601912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13344): Terminating (SIGTERM) 08:26:35.641511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Terminating (SIGTERM) 08:26:35.681447 --- ParallelTerminationStrategy: PID 13341 died... 08:26:35.700524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13341): Terminated: ok {rc=0} 08:26:35.744640 --- ParallelTerminationStrategy: PID 13344 died... 08:26:35.763224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13344): Terminated: ok {rc=0} 08:26:35.806850 --- ParallelTerminationStrategy: PID 13347 died... 08:26:35.825418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Terminated: ok {rc=0} 08:26:35.908906 bus /sierra_3: Setting Powered False 08:26:37.005541 bus /sierra_3: Setting Powered False 08:26:38.121912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:26:39.362772 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:26:39.370844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:26:39.392853 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:26:39.421423 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:26:39.474327 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:26:39.496137 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:26:39.524406 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:26:40.079030 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:26:40.131526 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:40.142833 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:26:40.198499 tst mo_mt_call.py: using LAC 20191 08:26:40.319345 tst mo_mt_call.py: using RAC 46 08:26:40.449150 tst mo_mt_call.py: using CellId 20191 08:26:40.582604 tst mo_mt_call.py: using BVCI 20192 08:26:40.703405 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:40.715258 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:40.726867 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:40.738526 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:40.750308 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:40.762148 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:26:40.879867 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:26:40.999253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:41.509208 run create_hlr_db(pid=13354): Launched 08:26:41.634107 bus /sierra_2: Setting Powered False 08:26:42.698913 run create_hlr_db(pid=13354): Terminated: ok {rc=0} 08:26:43.135344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13356): Launched 08:26:43.441220 run osmo-hlr_10.42.42.2(pid=13357): Launched 08:26:43.558982 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:44.085357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13359): Launched 08:26:44.391991 run osmo-stp_10.42.42.5(pid=13360): Launched 08:26:44.509667 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:45.063929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13362): Launched 08:26:45.370985 run osmo-msc_10.42.42.6(pid=13363): Launched 08:26:45.542336 run osmo-stp_10.42.42.5(pid=13360): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13360)] 08:26:45.670616 run osmo-stp_10.42.42.5(pid=13360): stdout: | (launched: 2022-12-09_08:26:44.335159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:45.798967 run osmo-stp_10.42.42.5(pid=13360): stderr: | [0;m[38;5;43m20221209082644502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082644502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082644503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082644503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082644504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082644504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082644504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:45.934167 run osmo-stp_10.42.42.5(pid=13360): stdout: | (launched: 2022-12-09_08:26:44.335159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:46.058297 run osmo-stp_10.42.42.5(pid=13360): stderr: | [0;m[38;5;43m20221209082644502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082644502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082644503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082644503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082644504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082644504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082644504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:46.207518 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13360): Process ended prematurely: osmo-stp_10.42.42.5(pid=13360) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13360)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:26:46.217547 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:26:46.244994 run osmo-hlr_10.42.42.2(pid=13357): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13357)] 08:26:46.295190 run osmo-hlr_10.42.42.2(pid=13357): stdout: | (launched: 2022-12-09_08:26:43.385571) 08:26:46.345969 run osmo-hlr_10.42.42.2(pid=13357): stderr: | [0;m[1;31m20221209082643560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082643560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082643560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082643560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082643560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082643560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082643584 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082643594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082643594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082643594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:46.416364 run osmo-msc_10.42.42.6(pid=13363): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13363)] 08:26:46.466497 run osmo-msc_10.42.42.6(pid=13363): stdout: | (launched: 2022-12-09_08:26:45.315198) 08:26:46.516719 run osmo-msc_10.42.42.6(pid=13363): stderr: | [0;m[38;5;43m20221209082645583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082645583 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02f0000c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082645583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082645583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082645583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082645584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082645585 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082645586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082645586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082645586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:46.568160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13356): Terminating (SIGTERM) 08:26:46.608388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13359): Terminating (SIGTERM) 08:26:46.649449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13362): Terminating (SIGTERM) 08:26:46.690287 --- ParallelTerminationStrategy: PID 13356 died... 08:26:46.709258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13356): Terminated: ok {rc=0} 08:26:46.754584 --- ParallelTerminationStrategy: PID 13359 died... 08:26:46.773699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13359): Terminated: ok {rc=0} 08:26:46.819029 --- ParallelTerminationStrategy: PID 13362 died... 08:26:46.838579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13362): Terminated: ok {rc=0} 08:26:46.924685 bus /sierra_3: Setting Powered False 08:26:48.022620 bus /sierra_3: Setting Powered False 08:26:49.139385 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:26:50.289887 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:50.302841 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:26:50.369211 tst mo_mt_call_osmux.py: using LAC 20192 08:26:50.499845 tst mo_mt_call_osmux.py: using RAC 47 08:26:50.622250 tst mo_mt_call_osmux.py: using CellId 20192 08:26:50.741639 tst mo_mt_call_osmux.py: using BVCI 20193 08:26:50.852896 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:50.864233 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:50.875435 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:50.886483 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:50.897490 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:26:50.908446 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:26:51.027959 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:26:51.146947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:51.624370 run create_hlr_db(pid=13365): Launched 08:26:51.750071 bus /sierra_2: Setting Powered False 08:26:52.810868 run create_hlr_db(pid=13365): Terminated: ok {rc=0} 08:26:53.237706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13367): Launched 08:26:53.544909 run osmo-hlr_10.42.42.2(pid=13368): Launched 08:26:53.662042 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:54.189437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13370): Launched 08:26:54.496190 run osmo-stp_10.42.42.5(pid=13371): Launched 08:26:54.614165 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:55.169158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13373): Launched 08:26:55.476017 run osmo-msc_10.42.42.6(pid=13374): Launched 08:26:55.648404 run osmo-stp_10.42.42.5(pid=13371): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13371)] 08:26:55.777778 run osmo-stp_10.42.42.5(pid=13371): stdout: | (launched: 2022-12-09_08:26:54.439716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:55.907378 run osmo-stp_10.42.42.5(pid=13371): stderr: | [0;m[38;5;43m20221209082654609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082654610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082654610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082654610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082654611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082654611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082654611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:56.034983 run osmo-stp_10.42.42.5(pid=13371): stdout: | (launched: 2022-12-09_08:26:54.439716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:56.157801 run osmo-stp_10.42.42.5(pid=13371): stderr: | [0;m[38;5;43m20221209082654609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082654610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082654610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082654610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082654611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082654611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082654611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:56.304351 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13371): Process ended prematurely: osmo-stp_10.42.42.5(pid=13371) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13371)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:26:56.313535 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:26:56.339961 run osmo-hlr_10.42.42.2(pid=13368): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13368)] 08:26:56.387866 run osmo-hlr_10.42.42.2(pid=13368): stdout: | (launched: 2022-12-09_08:26:53.489235) 08:26:56.437620 run osmo-hlr_10.42.42.2(pid=13368): stderr: | [0;m[1;31m20221209082653663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082653663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082653663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082653663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082653663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082653663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082653675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082653683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082653684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082653684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:56.507125 run osmo-msc_10.42.42.6(pid=13374): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13374)] 08:26:56.555081 run osmo-msc_10.42.42.6(pid=13374): stdout: | (launched: 2022-12-09_08:26:55.419925) 08:26:56.604869 run osmo-msc_10.42.42.6(pid=13374): stderr: | [0;m[38;5;43m20221209082655691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082655691 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff5e846fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082655691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082655691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082655691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082655691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082655693 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082655694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082655694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082655694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:56.654805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13367): Terminating (SIGTERM) 08:26:56.695745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13370): Terminating (SIGTERM) 08:26:56.735898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13373): Terminating (SIGTERM) 08:26:56.776200 --- ParallelTerminationStrategy: PID 13367 died... 08:26:56.795516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13367): Terminated: ok {rc=0} 08:26:56.840235 --- ParallelTerminationStrategy: PID 13370 died... 08:26:56.859115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13370): Terminated: ok {rc=0} 08:26:56.903076 --- ParallelTerminationStrategy: PID 13373 died... 08:26:56.921771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13373): Terminated: ok {rc=0} 08:26:57.007092 bus /sierra_3: Setting Powered False 08:26:58.106868 bus /sierra_3: Setting Powered False 08:26:59.220079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:27:00.460382 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:27:00.467409 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:27:00.490125 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:27:00.519099 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:27:00.573077 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:27:00.595041 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:27:00.623320 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:27:01.172198 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:27:01.226578 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:01.239014 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:27:01.299338 tst mo_mt_call.py: using LAC 20193 08:27:01.457574 tst mo_mt_call.py: using RAC 48 08:27:01.585715 tst mo_mt_call.py: using CellId 20193 08:27:01.708195 tst mo_mt_call.py: using BVCI 20194 08:27:01.848939 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:01.861864 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:01.875147 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:01.888620 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:01.901271 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:01.914741 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:27:02.038803 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:27:02.160066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:02.641575 run create_hlr_db(pid=13379): Launched 08:27:02.768881 bus /sierra_2: Setting Powered False 08:27:03.830854 run create_hlr_db(pid=13379): Terminated: ok {rc=0} 08:27:04.259472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13381): Launched 08:27:04.568088 run osmo-hlr_10.42.42.2(pid=13382): Launched 08:27:04.686028 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:05.230586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13384): Launched 08:27:05.539773 run osmo-stp_10.42.42.5(pid=13385): Launched 08:27:05.657581 run osmo-msc_10.42.42.6: Starting osmo-msc 08:27:06.213237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13387): Launched 08:27:06.520896 run osmo-msc_10.42.42.6(pid=13388): Launched 08:27:06.695178 run osmo-stp_10.42.42.5(pid=13385): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13385)] 08:27:06.824866 run osmo-stp_10.42.42.5(pid=13385): stdout: | (launched: 2022-12-09_08:27:05.483314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:06.955736 run osmo-stp_10.42.42.5(pid=13385): stderr: | [0;m[38;5;43m20221209082705653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082705653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082705653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082705654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082705654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082705654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082705654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:07.083819 run osmo-stp_10.42.42.5(pid=13385): stdout: | (launched: 2022-12-09_08:27:05.483314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:07.207022 run osmo-stp_10.42.42.5(pid=13385): stderr: | [0;m[38;5;43m20221209082705653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082705653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082705653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082705654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082705654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082705654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082705654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:07.354429 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13385): Process ended prematurely: osmo-stp_10.42.42.5(pid=13385) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13385)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:27:07.363491 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:27:07.389927 run osmo-hlr_10.42.42.2(pid=13382): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13382)] 08:27:07.438016 run osmo-hlr_10.42.42.2(pid=13382): stdout: | (launched: 2022-12-09_08:27:04.511452) 08:27:07.487505 run osmo-hlr_10.42.42.2(pid=13382): stderr: | [0;m[1;31m20221209082704685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082704685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082704685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082704685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082704685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082704685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082704697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082704705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082704706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082704706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:07.556124 run osmo-msc_10.42.42.6(pid=13388): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13388)] 08:27:07.603474 run osmo-msc_10.42.42.6(pid=13388): stdout: | (launched: 2022-12-09_08:27:06.464938) 08:27:07.652502 run osmo-msc_10.42.42.6(pid=13388): stderr: | [0;m[38;5;43m20221209082706736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082706736 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f287425ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082706736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082706736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082706736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082706737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082706738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082706739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082706739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082706739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:27:07.702083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13381): Terminating (SIGTERM) 08:27:07.742290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13384): Terminating (SIGTERM) 08:27:07.782382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13387): Terminating (SIGTERM) 08:27:07.822761 --- ParallelTerminationStrategy: PID 13381 died... 08:27:07.841807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13381): Terminated: ok {rc=0} 08:27:07.886078 --- ParallelTerminationStrategy: PID 13384 died... 08:27:07.904847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13384): Terminated: ok {rc=0} 08:27:07.949514 --- ParallelTerminationStrategy: PID 13387 died... 08:27:07.968389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13387): Terminated: ok {rc=0} 08:27:08.052801 bus /sierra_3: Setting Powered False 08:27:09.148941 bus /sierra_3: Setting Powered False 08:27:10.266003 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:27:11.415066 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:11.427098 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:27:11.485272 tst mo_mt_call_osmux.py: using LAC 20194 08:27:11.607659 tst mo_mt_call_osmux.py: using RAC 49 08:27:11.729520 tst mo_mt_call_osmux.py: using CellId 20194 08:27:11.852791 tst mo_mt_call_osmux.py: using BVCI 20195 08:27:11.965711 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:11.977107 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:11.988056 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:11.999187 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:12.010385 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:27:12.021635 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:27:12.143517 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:27:12.264335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:12.741027 run create_hlr_db(pid=13390): Launched 08:27:12.866103 bus /sierra_2: Setting Powered False 08:27:13.927204 run create_hlr_db(pid=13390): Terminated: ok {rc=0} 08:27:14.373256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Launched 08:27:14.701321 run osmo-hlr_10.42.42.2(pid=13393): Launched 08:27:14.826553 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:15.393271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Launched 08:27:15.720237 run osmo-stp_10.42.42.5(pid=13396): Launched 08:27:15.885639 run osmo-msc_10.42.42.6: Starting osmo-msc 08:27:16.631132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13398): Launched 08:27:16.958939 run osmo-msc_10.42.42.6(pid=13399): Launched 08:27:17.424578 run osmo-stp_10.42.42.5(pid=13396): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] 08:27:17.583394 run osmo-stp_10.42.42.5(pid=13396): stdout: | (launched: 2022-12-09_08:27:15.661113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:17.720324 run osmo-stp_10.42.42.5(pid=13396): stderr: | [0;m[38;5;43m20221209082715853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082715854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082715854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082715854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082715855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082715855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082715855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:17.857081 run osmo-stp_10.42.42.5(pid=13396): stdout: | (launched: 2022-12-09_08:27:15.661113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:17.988738 run osmo-stp_10.42.42.5(pid=13396): stderr: | [0;m[38;5;43m20221209082715853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082715854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082715854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082715854 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082715855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082715855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082715855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:18.146255 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13396): Process ended prematurely: osmo-stp_10.42.42.5(pid=13396) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:27:18.155979 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 08:27:18.184491 run osmo-hlr_10.42.42.2(pid=13393): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13393)] 08:27:18.235459 run osmo-hlr_10.42.42.2(pid=13393): stdout: | (launched: 2022-12-09_08:27:14.641586) 08:27:18.287966 run osmo-hlr_10.42.42.2(pid=13393): stderr: | [0;m[1;31m20221209082714840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082714840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082714840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082714840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082714841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082714841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082714853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082714861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082714862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082714862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:18.361314 run osmo-msc_10.42.42.6(pid=13399): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13399)] 08:27:18.412139 run osmo-msc_10.42.42.6(pid=13399): stdout: | (launched: 2022-12-09_08:27:16.899630) 08:27:18.464611 run osmo-msc_10.42.42.6(pid=13399): stderr: | [0;m[38;5;43m20221209082717239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082717239 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f917fadbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082717239 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082717239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082717240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082717240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082717243 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082717243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082717243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082717243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:27:18.517669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Terminating (SIGTERM) 08:27:18.559952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Terminating (SIGTERM) 08:27:18.602580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13398): Terminating (SIGTERM) 08:27:18.645464 --- ParallelTerminationStrategy: PID 13392 died... 08:27:18.665723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Terminated: ok {rc=0} 08:27:18.712714 --- ParallelTerminationStrategy: PID 13395 died... 08:27:18.732497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Terminated: ok {rc=0} 08:27:18.779517 --- ParallelTerminationStrategy: PID 13398 died... 08:27:18.799246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13398): Terminated: ok {rc=0} 08:27:18.887587 bus /sierra_3: Setting Powered False 08:27:19.987243 bus /sierra_3: Setting Powered False 08:27:21.104014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:27:22.340294 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:27:22.346648 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:27:22.368116 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:27:22.395219 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:27:22.448845 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:27:22.470801 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:27:22.498086 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:27:23.048817 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:27:23.098464 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:23.110107 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:27:23.167691 tst mo_mt_call.py: using LAC 20195 08:27:23.288814 tst mo_mt_call.py: using RAC 50 08:27:23.408785 tst mo_mt_call.py: using CellId 20195 08:27:23.528699 tst mo_mt_call.py: using BVCI 20196 08:27:23.649594 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:23.661439 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:23.673082 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:23.684864 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:23.696616 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:23.708589 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:27:23.826738 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:27:23.944124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:24.420756 run create_hlr_db(pid=13404): Launched 08:27:24.547135 bus /sierra_2: Setting Powered False 08:27:25.608103 run create_hlr_db(pid=13404): Terminated: ok {rc=0} 08:27:26.058766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13406): Launched 08:27:26.389605 run osmo-hlr_10.42.42.2(pid=13407): Launched 08:27:26.516097 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:27.083325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13409): Launched 08:27:27.412878 run osmo-stp_10.42.42.5(pid=13410): Launched 08:27:27.540267 run osmo-msc_10.42.42.6: Starting osmo-msc 08:27:28.134221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13412): Launched 08:27:28.465638 run osmo-msc_10.42.42.6(pid=13413): Launched 08:27:28.649551 run osmo-stp_10.42.42.5(pid=13410): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13410)] 08:27:28.787991 run osmo-stp_10.42.42.5(pid=13410): stdout: | (launched: 2022-12-09_08:27:27.353075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:28.927447 run osmo-stp_10.42.42.5(pid=13410): stderr: | [0;m[38;5;43m20221209082727541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082727541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082727541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082727541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082727542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082727542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082727542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:29.064915 run osmo-stp_10.42.42.5(pid=13410): stdout: | (launched: 2022-12-09_08:27:27.353075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:29.196844 run osmo-stp_10.42.42.5(pid=13410): stderr: | [0;m[38;5;43m20221209082727541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082727541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082727541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082727541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082727542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082727542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082727542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:29.355011 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13410): Process ended prematurely: osmo-stp_10.42.42.5(pid=13410) [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13410)] [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:27:29.364858 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:27:29.393403 run osmo-hlr_10.42.42.2(pid=13407): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13407)] 08:27:29.443942 run osmo-hlr_10.42.42.2(pid=13407): stdout: | (launched: 2022-12-09_08:27:26.330000) 08:27:29.495939 run osmo-hlr_10.42.42.2(pid=13407): stderr: | [0;m[1;31m20221209082726523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082726523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082726524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082726524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082726524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082726524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082726536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082726544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082726544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082726544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:29.568223 run osmo-msc_10.42.42.6(pid=13413): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13413)] 08:27:29.618903 run osmo-msc_10.42.42.6(pid=13413): stdout: | (launched: 2022-12-09_08:27:28.405697) 08:27:29.671125 run osmo-msc_10.42.42.6(pid=13413): stderr: | [0;m[38;5;43m20221209082728727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082728727 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0511f1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082728727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082728728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082728728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082728728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082728730 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082728730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082728730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082728730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:27:29.723361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13406): Terminating (SIGTERM) 08:27:29.765577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13409): Terminating (SIGTERM) 08:27:29.807891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13412): Terminating (SIGTERM) 08:27:29.850656 --- ParallelTerminationStrategy: PID 13406 died... 08:27:29.870725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13406): Terminated: ok {rc=0} 08:27:29.917716 --- ParallelTerminationStrategy: PID 13409 died... 08:27:29.937542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13409): Terminated: ok {rc=0} 08:27:29.984179 --- ParallelTerminationStrategy: PID 13412 died... 08:27:30.003917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13412): Terminated: ok {rc=0} 08:27:30.091467 bus /sierra_3: Setting Powered False 08:27:31.192493 bus /sierra_3: Setting Powered False 08:27:32.308942 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:27:33.454356 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:33.466428 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:27:33.524786 tst mo_mt_call_osmux.py: using LAC 20196 08:27:33.658261 tst mo_mt_call_osmux.py: using RAC 51 08:27:33.785354 tst mo_mt_call_osmux.py: using CellId 20196 08:27:33.912272 tst mo_mt_call_osmux.py: using BVCI 20197 08:27:34.031763 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:34.043765 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:34.055462 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:34.067438 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:34.079090 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:27:34.091013 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:27:34.213132 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:27:34.333441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:34.810695 run create_hlr_db(pid=13415): Launched 08:27:34.936105 bus /sierra_2: Setting Powered False 08:27:35.997761 run create_hlr_db(pid=13415): Terminated: ok {rc=0} 08:27:36.445913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13418): Launched 08:27:36.775837 run osmo-hlr_10.42.42.2(pid=13419): Launched 08:27:36.902062 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:37.470871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13421): Launched 08:27:37.800655 run osmo-stp_10.42.42.5(pid=13422): Launched 08:27:37.927575 run osmo-msc_10.42.42.6: Starting osmo-msc 08:27:38.522049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13424): Launched 08:27:38.852733 run osmo-msc_10.42.42.6(pid=13425): Launched 08:27:39.038301 run osmo-stp_10.42.42.5(pid=13422): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13422)] 08:27:39.177084 run osmo-stp_10.42.42.5(pid=13422): stdout: | (launched: 2022-12-09_08:27:37.741269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:39.316441 run osmo-stp_10.42.42.5(pid=13422): stderr: | [0;m[38;5;43m20221209082737930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082737930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082737930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082737931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082737931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082737931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082737932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:39.454332 run osmo-stp_10.42.42.5(pid=13422): stdout: | (launched: 2022-12-09_08:27:37.741269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:39.586044 run osmo-stp_10.42.42.5(pid=13422): stderr: | [0;m[38;5;43m20221209082737930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082737930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082737930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082737931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082737931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082737931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082737932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:39.743328 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13422): Process ended prematurely: osmo-stp_10.42.42.5(pid=13422) [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13422)] [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:27:39.752842 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:27:39.780864 run osmo-hlr_10.42.42.2(pid=13419): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13419)] 08:27:39.831567 run osmo-hlr_10.42.42.2(pid=13419): stdout: | (launched: 2022-12-09_08:27:36.716377) 08:27:39.883665 run osmo-hlr_10.42.42.2(pid=13419): stderr: | [0;m[1;31m20221209082736912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082736912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082736912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082736912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082736912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082736912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082736925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082736933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082736934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082736934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:39.956240 run osmo-msc_10.42.42.6(pid=13425): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13425)] 08:27:40.006727 run osmo-msc_10.42.42.6(pid=13425): stdout: | (launched: 2022-12-09_08:27:38.792641) 08:27:40.058724 run osmo-msc_10.42.42.6(pid=13425): stderr: | [0;m[38;5;43m20221209082739113 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082739113 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60e2443c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082739113 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082739113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082739113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082739114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082739115 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082739116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082739116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082739116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:27:40.111089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13418): Terminating (SIGTERM) 08:27:40.153019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13421): Terminating (SIGTERM) 08:27:40.194977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13424): Terminating (SIGTERM) 08:27:40.237280 --- ParallelTerminationStrategy: PID 13418 died... 08:27:40.257274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13418): Terminated: ok {rc=0} 08:27:40.303960 --- ParallelTerminationStrategy: PID 13421 died... 08:27:40.323796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13421): Terminated: ok {rc=0} 08:27:40.370382 --- ParallelTerminationStrategy: PID 13424 died... 08:27:40.389899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13424): Terminated: ok {rc=0} 08:27:40.477795 bus /sierra_3: Setting Powered False 08:27:41.577107 bus /sierra_3: Setting Powered False 08:27:42.694130 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:27:43.930759 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:27:43.936315 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:27:43.957568 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:27:43.984759 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:27:44.036580 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:27:44.057531 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:27:44.084340 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:27:44.634712 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:27:44.684170 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:44.695365 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:27:44.753328 tst mo_mt_call.py: using LAC 20197 08:27:44.877522 tst mo_mt_call.py: using RAC 52 08:27:44.999669 tst mo_mt_call.py: using CellId 20197 08:27:45.121836 tst mo_mt_call.py: using BVCI 20198 08:27:45.243412 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:45.255161 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:45.266672 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:45.278291 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:45.290067 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:45.301841 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:27:45.424703 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:27:45.547050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:46.111483 run create_hlr_db(pid=13430): Launched 08:27:46.260338 bus /sierra_2: Setting Powered False 08:27:47.326171 run create_hlr_db(pid=13430): Terminated: ok {rc=0} 08:27:47.783465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Launched 08:27:48.112756 run osmo-hlr_10.42.42.2(pid=13433): Launched 08:27:48.240568 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:48.807655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Launched 08:27:49.137747 run osmo-stp_10.42.42.5(pid=13436): Launched 08:27:49.266252 run osmo-msc_10.42.42.6: Starting osmo-msc 08:27:49.863686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13438): Launched 08:27:50.195152 run osmo-msc_10.42.42.6(pid=13439): Launched 08:27:50.380652 run osmo-stp_10.42.42.5(pid=13436): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] 08:27:50.520744 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-09_08:27:49.078166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:50.660521 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221209082749271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082749271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082749271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082749272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082749272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082749272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082749272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:50.799282 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-09_08:27:49.078166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:50.931619 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221209082749271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082749271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082749271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082749272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082749272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082749272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082749272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:51.089321 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:27:51.098816 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:27:51.126767 run osmo-hlr_10.42.42.2(pid=13433): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13433)] 08:27:51.177149 run osmo-hlr_10.42.42.2(pid=13433): stdout: | (launched: 2022-12-09_08:27:48.053395) 08:27:51.229463 run osmo-hlr_10.42.42.2(pid=13433): stderr: | [0;m[1;31m20221209082748251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082748251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082748251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082748251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082748251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082748251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082748263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082748272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082748272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082748272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:51.302046 run osmo-msc_10.42.42.6(pid=13439): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13439)] 08:27:51.352798 run osmo-msc_10.42.42.6(pid=13439): stdout: | (launched: 2022-12-09_08:27:50.135501) 08:27:51.404865 run osmo-msc_10.42.42.6(pid=13439): stderr: | [0;m[38;5;43m20221209082750458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082750458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44f653ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082750458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082750458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082750458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082750459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082750460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082750461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082750461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082750461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:27:51.457172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Terminating (SIGTERM) 08:27:51.499086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminating (SIGTERM) 08:27:51.541011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13438): Terminating (SIGTERM) 08:27:51.583394 --- ParallelTerminationStrategy: PID 13432 died... 08:27:51.603313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Terminated: ok {rc=0} 08:27:51.649911 --- ParallelTerminationStrategy: PID 13435 died... 08:27:51.669405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminated: ok {rc=0} 08:27:51.716175 --- ParallelTerminationStrategy: PID 13438 died... 08:27:51.735713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13438): Terminated: ok {rc=0} 08:27:51.823442 bus /sierra_3: Setting Powered False 08:27:52.923112 bus /sierra_3: Setting Powered False 08:27:54.042646 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:27:55.194035 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:55.206539 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:27:55.267383 tst mo_mt_call_osmux.py: using LAC 20198 08:27:55.398946 tst mo_mt_call_osmux.py: using RAC 53 08:27:55.528783 tst mo_mt_call_osmux.py: using CellId 20198 08:27:55.650568 tst mo_mt_call_osmux.py: using BVCI 20199 08:27:55.763849 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:55.775393 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:55.786441 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:55.797550 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:55.808653 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:27:55.819807 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:27:55.940383 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:27:56.059243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:56.537808 run create_hlr_db(pid=13441): Launched 08:27:56.665153 bus /sierra_2: Setting Powered False 08:27:57.726398 run create_hlr_db(pid=13441): Terminated: ok {rc=0} 08:27:58.175318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13443): Launched 08:27:58.504374 run osmo-hlr_10.42.42.2(pid=13444): Launched 08:27:58.631538 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:59.199795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13446): Launched 08:27:59.529929 run osmo-stp_10.42.42.5(pid=13447): Launched 08:27:59.656555 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:00.252632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13449): Launched 08:28:00.582297 run osmo-msc_10.42.42.6(pid=13450): Launched 08:28:00.768690 run osmo-stp_10.42.42.5(pid=13447): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13447)] 08:28:01.009088 run osmo-stp_10.42.42.5(pid=13447): stdout: | (launched: 2022-12-09_08:27:59.470301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:01.260800 run osmo-stp_10.42.42.5(pid=13447): stderr: | [0;m[38;5;43m20221209082759663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082759663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082759663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082759664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082759664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082759664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082759664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:01.395142 run osmo-stp_10.42.42.5(pid=13447): stdout: | (launched: 2022-12-09_08:27:59.470301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:01.523419 run osmo-stp_10.42.42.5(pid=13447): stderr: | [0;m[38;5;43m20221209082759663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082759663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082759663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082759664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082759664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082759664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082759664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:01.679086 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13447): Process ended prematurely: osmo-stp_10.42.42.5(pid=13447) [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13447)] [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:28:01.688667 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:28:01.717390 run osmo-hlr_10.42.42.2(pid=13444): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13444)] 08:28:01.768296 run osmo-hlr_10.42.42.2(pid=13444): stdout: | (launched: 2022-12-09_08:27:58.445314) 08:28:01.820448 run osmo-hlr_10.42.42.2(pid=13444): stderr: | [0;m[1;31m20221209082758643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082758643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082758643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082758643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082758643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082758643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082758655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082758664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082758664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082758664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:01.893614 run osmo-msc_10.42.42.6(pid=13450): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13450)] 08:28:01.944152 run osmo-msc_10.42.42.6(pid=13450): stdout: | (launched: 2022-12-09_08:28:00.522334) 08:28:01.997185 run osmo-msc_10.42.42.6(pid=13450): stderr: | [0;m[38;5;43m20221209082800873 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082800878 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d9eea8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082800879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082800879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082800879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082800879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082800881 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082800881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082800881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082800881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:02.049138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13443): Terminating (SIGTERM) 08:28:02.091691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13446): Terminating (SIGTERM) 08:28:02.136186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13449): Terminating (SIGTERM) 08:28:02.181868 --- ParallelTerminationStrategy: PID 13443 died... 08:28:02.201582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13443): Terminated: ok {rc=0} 08:28:02.248845 --- ParallelTerminationStrategy: PID 13446 died... 08:28:02.268255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13446): Terminated: ok {rc=0} 08:28:02.313187 --- ParallelTerminationStrategy: PID 13449 died... 08:28:02.331909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13449): Terminated: ok {rc=0} 08:28:02.419110 bus /sierra_3: Setting Powered False 08:28:03.519158 bus /sierra_3: Setting Powered False 08:28:04.635413 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:sysmo --------------------------------------------------------------------- 08:28:05.871439 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:28:05.876533 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 08:28:05.899005 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 08:28:05.926443 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 08:28:06.015073 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 08:28:06.038170 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 08:28:06.066649 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 08:28:06.648758 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 08:28:06.654266 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:06.665678 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:28:06.702751 tst emergency_mo_mt_call.py: using LAC 20199 08:28:06.831925 tst emergency_mo_mt_call.py: using RAC 54 08:28:06.953015 tst emergency_mo_mt_call.py: using CellId 20199 08:28:07.072500 tst emergency_mo_mt_call.py: using BVCI 20200 08:28:07.182279 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:07.193220 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:07.203958 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:07.214837 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:07.225738 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:07.236633 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:28:07.353152 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:28:07.471708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:07.974176 run create_hlr_db(pid=13455): Launched 08:28:08.100501 bus /sierra_2: Setting Powered False 08:28:09.164793 run create_hlr_db(pid=13455): Terminated: ok {rc=0} 08:28:09.616730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13457): Launched 08:28:09.941192 run osmo-hlr_10.42.42.2(pid=13458): Launched 08:28:10.067764 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:10.627347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13460): Launched 08:28:10.952090 run osmo-stp_10.42.42.5(pid=13461): Launched 08:28:11.086860 tst emergency_mo_mt_call.py: using MSISDN 7117 08:28:11.256537 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:11.839119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13463): Launched 08:28:12.164100 run osmo-msc_10.42.42.6(pid=13464): Launched 08:28:12.346288 run osmo-stp_10.42.42.5(pid=13461): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13461)] 08:28:12.483856 run osmo-stp_10.42.42.5(pid=13461): stdout: | (launched: 2022-12-09_08:28:10.892934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:12.621893 run osmo-stp_10.42.42.5(pid=13461): stderr: | [0;m[38;5;43m20221209082811087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082811087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082811088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082811088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:12.758817 run osmo-stp_10.42.42.5(pid=13461): stdout: | (launched: 2022-12-09_08:28:10.892934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:12.888370 run osmo-stp_10.42.42.5(pid=13461): stderr: | [0;m[38;5;43m20221209082811087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082811087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082811088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082811088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:13.043447 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13461): Process ended prematurely: osmo-stp_10.42.42.5(pid=13461) [trial-2357↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13461)] [trial-2357↪emergency:sysmo↪emergency_mo_mt_call.py:19] 08:28:13.052213 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 08:28:13.080342 run osmo-hlr_10.42.42.2(pid=13458): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13458)] 08:28:13.131917 run osmo-hlr_10.42.42.2(pid=13458): stdout: | (launched: 2022-12-09_08:28:09.882373) 08:28:13.184817 run osmo-hlr_10.42.42.2(pid=13458): stderr: | [0;m[1;31m20221209082810078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082810078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082810078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082810079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082810079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082810079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082810091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082810100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082810100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082810100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:13.258279 run osmo-msc_10.42.42.6(pid=13464): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13464)] 08:28:13.309400 run osmo-msc_10.42.42.6(pid=13464): stdout: | (launched: 2022-12-09_08:28:12.105219) 08:28:13.362302 run osmo-msc_10.42.42.6(pid=13464): stderr: | [0;m[38;5;43m20221209082812427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082812427 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2e4501ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082812427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082812427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082812427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082812428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082812430 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082812430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082812430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082812430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:13.415554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13457): Terminating (SIGTERM) 08:28:13.458180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13460): Terminating (SIGTERM) 08:28:13.500822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13463): Terminating (SIGTERM) 08:28:13.543846 --- ParallelTerminationStrategy: PID 13457 died... 08:28:13.564033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13457): Terminated: ok {rc=0} 08:28:13.611555 --- ParallelTerminationStrategy: PID 13460 died... 08:28:13.631394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13460): Terminated: ok {rc=0} 08:28:13.678498 --- ParallelTerminationStrategy: PID 13463 died... 08:28:13.698447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13463): Terminated: ok {rc=0} 08:28:13.787311 bus /sierra_3: Setting Powered False 08:28:14.886874 bus /sierra_3: Setting Powered False 08:28:16.001816 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 08:28:17.087350 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:17.100428 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:28:17.142017 tst emergency_preemptive_call.py: using LAC 20200 08:28:17.273732 tst emergency_preemptive_call.py: using RAC 55 08:28:17.405172 tst emergency_preemptive_call.py: using CellId 20200 08:28:17.530861 tst emergency_preemptive_call.py: using BVCI 20201 08:28:17.648471 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:17.659802 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:17.671153 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:17.682572 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:17.693953 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:28:17.705523 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:28:17.828586 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:28:17.955722 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:28:18.078604 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:28:18.198187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:18.700779 run create_hlr_db(pid=13466): Launched 08:28:18.826352 bus /sierra_2: Setting Powered False 08:28:19.890416 run create_hlr_db(pid=13466): Terminated: ok {rc=0} 08:28:20.325708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13468): Launched 08:28:20.651378 run osmo-hlr_10.42.42.2(pid=13469): Launched 08:28:20.776203 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:21.340047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13471): Launched 08:28:21.664854 run osmo-stp_10.42.42.5(pid=13472): Launched 08:28:21.802062 tst emergency_preemptive_call.py: using MSISDN 7118 08:28:21.971423 run osmo-msc_10.42.42.6: Starting osmo-msc 08:28:22.554048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13474): Launched 08:28:22.879114 run osmo-msc_10.42.42.6(pid=13475): Launched 08:28:23.068295 run osmo-stp_10.42.42.5(pid=13472): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13472)] 08:28:23.205249 run osmo-stp_10.42.42.5(pid=13472): stdout: | (launched: 2022-12-09_08:28:21.605800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:23.342787 run osmo-stp_10.42.42.5(pid=13472): stderr: | [0;m[38;5;43m20221209082821798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082821798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082821798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082821798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082821800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082821800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082821800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:23.479421 run osmo-stp_10.42.42.5(pid=13472): stdout: | (launched: 2022-12-09_08:28:21.605800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:23.608774 run osmo-stp_10.42.42.5(pid=13472): stderr: | [0;m[38;5;43m20221209082821798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082821798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082821798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082821798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082821800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082821800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082821800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:23.763886 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13472): Process ended prematurely: osmo-stp_10.42.42.5(pid=13472) [trial-2357↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13472)] [trial-2357↪emergency:sysmo↪emergency_preemptive_call.py:32] 08:28:23.772807 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 08:28:23.800690 run osmo-hlr_10.42.42.2(pid=13469): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13469)] 08:28:23.851055 run osmo-hlr_10.42.42.2(pid=13469): stdout: | (launched: 2022-12-09_08:28:20.592338) 08:28:23.903094 run osmo-hlr_10.42.42.2(pid=13469): stderr: | [0;m[1;31m20221209082820790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082820790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082820790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082820790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082820790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082820790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082820803 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082820813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082820813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082820814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:23.975399 run osmo-msc_10.42.42.6(pid=13475): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13475)] 08:28:24.025510 run osmo-msc_10.42.42.6(pid=13475): stdout: | (launched: 2022-12-09_08:28:22.819969) 08:28:24.077558 run osmo-msc_10.42.42.6(pid=13475): stderr: | [0;m[38;5;43m20221209082823140 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209082823141 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30ddc7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209082823141 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209082823141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209082823141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209082823141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209082823143 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209082823143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209082823144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209082823144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:28:24.130241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13468): Terminating (SIGTERM) 08:28:24.172304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13471): Terminating (SIGTERM) 08:28:24.214455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13474): Terminating (SIGTERM) 08:28:24.256767 --- ParallelTerminationStrategy: PID 13468 died... 08:28:24.276760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13468): Terminated: ok {rc=0} 08:28:24.323636 --- ParallelTerminationStrategy: PID 13471 died... 08:28:24.343736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13471): Terminated: ok {rc=0} 08:28:24.390309 --- ParallelTerminationStrategy: PID 13474 died... 08:28:24.409889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13474): Terminated: ok {rc=0} 08:28:24.498202 bus /sierra_9: Setting Powered False 08:28:25.597513 bus /sierra_9: Setting Powered False 08:28:26.713708 bus /sierra_8: Setting Powered False 08:28:27.809477 bus /sierra_8: Setting Powered False 08:28:28.923792 bus /sierra_3: Setting Powered False 08:28:30.022082 bus /sierra_3: Setting Powered False 08:28:31.148272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:sysmo --------------------------------------------------------------------- 08:28:32.432686 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:28:32.437386 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 08:28:32.459696 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 08:28:32.501037 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 08:28:32.591642 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 08:28:32.613502 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 08:28:32.654155 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 08:28:33.247326 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 08:28:33.302695 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.314029 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:28:33.350705 tst cs_paging_gprs_active.py: using LAC 20201 08:28:33.487682 tst cs_paging_gprs_active.py: using RAC 56 08:28:33.618480 tst cs_paging_gprs_active.py: using CellId 20201 08:28:33.745899 tst cs_paging_gprs_active.py: using BVCI 20202 08:28:33.867713 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.878896 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.889957 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.901171 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.912478 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.923930 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.935335 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.946720 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:33.958023 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:28:34.077542 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:28:34.200570 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:28:34.425651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:34.758617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13480): Launched 08:28:35.047421 run iperf3-srv_10.42.42.10(pid=13481): Launched 08:28:35.171394 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:28:35.395794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:35.727881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13482): Launched 08:28:36.013752 run iperf3-srv_10.42.42.10(pid=13483): Launched 08:28:36.138924 tst cs_paging_gprs_active.py:38: start network... 08:28:36.362275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:36.875877 run create_hlr_db(pid=13484): Launched 08:28:37.002037 bus /sierra_2: Setting Powered False 08:28:38.067287 run create_hlr_db(pid=13484): Terminated: ok {rc=0} 08:28:38.508418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13486): Launched 08:28:38.817662 run osmo-hlr_10.42.42.2(pid=13487): Launched 08:28:38.935810 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:39.467204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13489): Launched 08:28:39.775122 run osmo-stp_10.42.42.5(pid=13490): Launched 08:28:39.892877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:28:41.414287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13492): Launched 08:28:41.532603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:28:41.794416 run patchelf(pid=13493): Launched 08:28:41.967547 run osmo-stp_10.42.42.5(pid=13490): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13490)] 08:28:42.098338 run osmo-stp_10.42.42.5(pid=13490): stdout: | (launched: 2022-12-09_08:28:39.719065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:42.230665 run osmo-stp_10.42.42.5(pid=13490): stderr: | [0;m[38;5;43m20221209082839886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082839886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082839887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082839887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082839888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082839888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082839888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:42.363000 run osmo-stp_10.42.42.5(pid=13490): stdout: | (launched: 2022-12-09_08:28:39.719065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:42.490024 run osmo-stp_10.42.42.5(pid=13490): stderr: | [0;m[38;5;43m20221209082839886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082839886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082839887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082839887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082839888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082839888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082839888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:42.640213 run patchelf(pid=13493): Terminating (SIGINT) 08:28:42.813706 run patchelf(pid=13493): Terminated: ok {rc=0} 08:28:42.938507 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13490): Process ended prematurely: osmo-stp_10.42.42.5(pid=13490) [trial-2357↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13490)] [trial-2357↪gprs:sysmo↪cs_paging_gprs_active.py:38] 08:28:42.947741 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 08:28:42.975055 run osmo-hlr_10.42.42.2(pid=13487): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13487)] 08:28:43.023231 run osmo-hlr_10.42.42.2(pid=13487): stdout: | (launched: 2022-12-09_08:28:38.761533) 08:28:43.073087 run osmo-hlr_10.42.42.2(pid=13487): stderr: | [0;m[1;31m20221209082838937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082838937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082838937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082838937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082838937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082838937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082838949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082838957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082838958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082838958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:43.123262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13480): Terminating (SIGTERM) 08:28:43.163394 run iperf3-srv_10.42.42.10(pid=13481): Terminating (SIGTERM) 08:28:43.203677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13482): Terminating (SIGTERM) 08:28:43.243955 run iperf3-srv_10.42.42.10(pid=13483): Terminating (SIGTERM) 08:28:43.284052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13486): Terminating (SIGTERM) 08:28:43.324713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13489): Terminating (SIGTERM) 08:28:43.365040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13492): Terminating (SIGTERM) 08:28:43.405436 --- ParallelTerminationStrategy: PID 13480 died... 08:28:43.424703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13480): Terminated: ok {rc=0} 08:28:43.469297 --- ParallelTerminationStrategy: PID 13481 died... 08:28:43.487964 run iperf3-srv_10.42.42.10(pid=13481): Terminated {rc=256} 08:28:43.532444 --- ParallelTerminationStrategy: PID 13482 died... 08:28:43.551408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13482): Terminated: ok {rc=0} 08:28:43.595762 --- ParallelTerminationStrategy: PID 13483 died... 08:28:43.614709 run iperf3-srv_10.42.42.10(pid=13483): Terminated {rc=256} 08:28:43.659013 --- ParallelTerminationStrategy: PID 13486 died... 08:28:43.678195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13486): Terminated: ok {rc=0} 08:28:43.723060 --- ParallelTerminationStrategy: PID 13489 died... 08:28:43.742033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13489): Terminated: ok {rc=0} 08:28:43.786311 --- ParallelTerminationStrategy: PID 13492 died... 08:28:43.805220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13492): Terminated: ok {rc=0} 08:28:43.892439 bus /gobi_0: Setting Powered False 08:28:44.993318 bus /gobi_0: Setting Powered False 08:28:46.107292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo iperf3.py ---------------------------------------------- 08:28:47.274169 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.286272 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:28:47.325094 tst iperf3.py: using LAC 20202 08:28:47.457340 tst iperf3.py: using RAC 57 08:28:47.591406 tst iperf3.py: using CellId 20202 08:28:47.720268 tst iperf3.py: using BVCI 20203 08:28:47.840587 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.851765 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.862832 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.874300 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.885581 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.896833 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.908259 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.919917 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:47.931646 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:28:48.048810 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:28:48.257859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:48.567445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Launched 08:28:48.856412 run iperf3-srv_10.42.42.10(pid=13495): Launched 08:28:48.981388 tst iperf3.py:8: start network... 08:28:49.205191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:49.720555 run create_hlr_db(pid=13496): Launched 08:28:49.846662 bus /gobi_6: Setting Powered False 08:28:50.911768 run create_hlr_db(pid=13496): Terminated: ok {rc=0} 08:28:51.353216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13498): Launched 08:28:51.663078 run osmo-hlr_10.42.42.2(pid=13499): Launched 08:28:51.783076 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:52.329544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13501): Launched 08:28:52.637010 run osmo-stp_10.42.42.5(pid=13502): Launched 08:28:52.756641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:28:53.289434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13504): Launched 08:28:53.407484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:28:53.668583 run patchelf(pid=13505): Launched 08:28:53.840363 run osmo-stp_10.42.42.5(pid=13502): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13502)] 08:28:53.970388 run osmo-stp_10.42.42.5(pid=13502): stdout: | (launched: 2022-12-09_08:28:52.580605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:54.102418 run osmo-stp_10.42.42.5(pid=13502): stderr: | [0;m[38;5;43m20221209082852750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082852750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082852751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082852751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082852751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082852751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082852751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:54.233590 run osmo-stp_10.42.42.5(pid=13502): stdout: | (launched: 2022-12-09_08:28:52.580605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:54.359712 run osmo-stp_10.42.42.5(pid=13502): stderr: | [0;m[38;5;43m20221209082852750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082852750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082852751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082852751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082852751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082852751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082852751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:54.509453 run patchelf(pid=13505): Terminating (SIGINT) 08:28:54.682040 run patchelf(pid=13505): Terminated: ok {rc=0} 08:28:54.806201 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13502): Process ended prematurely: osmo-stp_10.42.42.5(pid=13502) [trial-2357↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13502)] [trial-2357↪gprs:sysmo↪iperf3.py:8] 08:28:54.815520 tst iperf3.py:8: Test FAILED (7.6 sec) 08:28:54.842622 run osmo-hlr_10.42.42.2(pid=13499): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13499)] 08:28:54.890315 run osmo-hlr_10.42.42.2(pid=13499): stdout: | (launched: 2022-12-09_08:28:51.606714) 08:28:54.939915 run osmo-hlr_10.42.42.2(pid=13499): stderr: | [0;m[1;31m20221209082851783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082851783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082851783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082851783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082851783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082851783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082851796 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082851806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082851806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082851806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:54.989863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Terminating (SIGTERM) 08:28:55.030265 run iperf3-srv_10.42.42.10(pid=13495): Terminating (SIGTERM) 08:28:55.070334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13498): Terminating (SIGTERM) 08:28:55.110681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13501): Terminating (SIGTERM) 08:28:55.150684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13504): Terminating (SIGTERM) 08:28:55.190805 --- ParallelTerminationStrategy: PID 13494 died... 08:28:55.210031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Terminated: ok {rc=0} 08:28:55.254402 --- ParallelTerminationStrategy: PID 13495 died... 08:28:55.273198 run iperf3-srv_10.42.42.10(pid=13495): Terminated {rc=256} 08:28:55.317386 --- ParallelTerminationStrategy: PID 13498 died... 08:28:55.336175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13498): Terminated: ok {rc=0} 08:28:55.380804 --- ParallelTerminationStrategy: PID 13501 died... 08:28:55.399986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13501): Terminated: ok {rc=0} 08:28:55.444841 --- ParallelTerminationStrategy: PID 13504 died... 08:28:55.464094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13504): Terminated: ok {rc=0} 08:28:55.548620 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo iperf3m4.py ---------------------------------------------- 08:28:56.700485 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:56.712551 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:28:56.750823 tst iperf3m4.py: using LAC 20203 08:28:56.882782 tst iperf3m4.py: using RAC 58 08:28:57.011283 tst iperf3m4.py: using CellId 20203 08:28:57.146596 tst iperf3m4.py: using BVCI 20204 08:28:57.267390 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.278820 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.290219 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.301758 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.313057 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.324135 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.335745 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.347241 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:28:57.359075 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:28:57.481877 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:28:57.605471 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:28:57.725699 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:28:57.842774 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:28:58.050148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:58.360608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13506): Launched 08:28:58.631767 run iperf3-srv_10.42.42.10(pid=13507): Launched 08:28:58.747955 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:28:58.955905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:59.266235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13508): Launched 08:28:59.537658 run iperf3-srv_10.42.42.10(pid=13509): Launched 08:28:59.653445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:28:59.860419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:00.170302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13510): Launched 08:29:00.438372 run iperf3-srv_10.42.42.10(pid=13511): Launched 08:29:00.553965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:29:00.760254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:01.088603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13513): Launched 08:29:01.401702 run iperf3-srv_10.42.42.10(pid=13514): Launched 08:29:01.526958 tst iperf3m4.py:8: start network... 08:29:01.737922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:02.232507 run create_hlr_db(pid=13515): Launched 08:29:02.359836 bus /gobi_6: Setting Powered False 08:29:03.421424 run create_hlr_db(pid=13515): Terminated: ok {rc=0} 08:29:03.881632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13517): Launched 08:29:04.212312 run osmo-hlr_10.42.42.2(pid=13518): Launched 08:29:04.340274 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:04.912368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13520): Launched 08:29:05.242921 run osmo-stp_10.42.42.5(pid=13521): Launched 08:29:05.371076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:05.941828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13523): Launched 08:29:06.068071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:06.348469 run patchelf(pid=13524): Launched 08:29:06.532859 run osmo-stp_10.42.42.5(pid=13521): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13521)] 08:29:06.672705 run osmo-stp_10.42.42.5(pid=13521): stdout: | (launched: 2022-12-09_08:29:05.183006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:06.814510 run osmo-stp_10.42.42.5(pid=13521): stderr: | [0;m[38;5;43m20221209082905371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082905371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082905372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082905372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082905373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082905373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082905373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:06.956311 run osmo-stp_10.42.42.5(pid=13521): stdout: | (launched: 2022-12-09_08:29:05.183006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:07.092167 run osmo-stp_10.42.42.5(pid=13521): stderr: | [0;m[38;5;43m20221209082905371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082905371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082905372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082905372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082905373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082905373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082905373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:07.253245 run patchelf(pid=13524): Terminating (SIGINT) 08:29:07.438948 run patchelf(pid=13524): Terminated: ok {rc=0} 08:29:07.572591 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13521): Process ended prematurely: osmo-stp_10.42.42.5(pid=13521) [trial-2357↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13521)] [trial-2357↪gprs:sysmo↪iperf3m4.py:8] 08:29:07.582883 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:29:07.612526 run osmo-hlr_10.42.42.2(pid=13518): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13518)] 08:29:07.663748 run osmo-hlr_10.42.42.2(pid=13518): stdout: | (launched: 2022-12-09_08:29:04.152404) 08:29:07.716458 run osmo-hlr_10.42.42.2(pid=13518): stderr: | [0;m[1;31m20221209082904346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082904346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082904346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082904346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082904346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082904346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082904358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082904368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082904368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082904368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:07.769947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13506): Terminating (SIGTERM) 08:29:07.812765 run iperf3-srv_10.42.42.10(pid=13507): Terminating (SIGTERM) 08:29:07.855548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13508): Terminating (SIGTERM) 08:29:07.898689 run iperf3-srv_10.42.42.10(pid=13509): Terminating (SIGTERM) 08:29:07.941644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13510): Terminating (SIGTERM) 08:29:07.984647 run iperf3-srv_10.42.42.10(pid=13511): Terminating (SIGTERM) 08:29:08.028040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13513): Terminating (SIGTERM) 08:29:08.071043 run iperf3-srv_10.42.42.10(pid=13514): Terminating (SIGTERM) 08:29:08.113954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13517): Terminating (SIGTERM) 08:29:08.156795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13520): Terminating (SIGTERM) 08:29:08.199788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13523): Terminating (SIGTERM) 08:29:08.242722 --- ParallelTerminationStrategy: PID 13506 died... 08:29:08.263037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13506): Terminated: ok {rc=0} 08:29:08.310807 --- ParallelTerminationStrategy: PID 13507 died... 08:29:08.330793 run iperf3-srv_10.42.42.10(pid=13507): Terminated {rc=256} 08:29:08.378447 --- ParallelTerminationStrategy: PID 13508 died... 08:29:08.398434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13508): Terminated: ok {rc=0} 08:29:08.445949 --- ParallelTerminationStrategy: PID 13509 died... 08:29:08.465815 run iperf3-srv_10.42.42.10(pid=13509): Terminated {rc=256} 08:29:08.513400 --- ParallelTerminationStrategy: PID 13510 died... 08:29:08.533340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13510): Terminated: ok {rc=0} 08:29:08.580859 --- ParallelTerminationStrategy: PID 13511 died... 08:29:08.601170 run iperf3-srv_10.42.42.10(pid=13511): Terminated {rc=256} 08:29:08.648360 --- ParallelTerminationStrategy: PID 13513 died... 08:29:08.668248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13513): Terminated: ok {rc=0} 08:29:08.715908 --- ParallelTerminationStrategy: PID 13514 died... 08:29:08.735789 run iperf3-srv_10.42.42.10(pid=13514): Terminated {rc=256} 08:29:08.783150 --- ParallelTerminationStrategy: PID 13517 died... 08:29:08.803235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13517): Terminated: ok {rc=0} 08:29:08.850663 --- ParallelTerminationStrategy: PID 13520 died... 08:29:08.870642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13520): Terminated: ok {rc=0} 08:29:08.917939 --- ParallelTerminationStrategy: PID 13523 died... 08:29:08.937904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13523): Terminated: ok {rc=0} 08:29:09.027530 bus /gobi_4: Setting Powered False 08:29:10.127649 bus /gobi_4: Setting Powered False 08:29:11.247680 bus /gobi_1: Setting Powered False 08:29:12.346195 bus /gobi_1: Setting Powered False 08:29:13.461700 bus /gobi_0: Setting Powered False 08:29:14.558908 bus /gobi_0: Setting Powered False 08:29:15.676355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo ping.py ---------------------------------------------- 08:29:16.776607 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:16.788898 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:29:16.826814 tst ping.py: using LAC 20204 08:29:16.992062 tst ping.py: using RAC 59 08:29:17.122899 tst ping.py: using CellId 20204 08:29:17.252459 tst ping.py: using BVCI 20205 08:29:17.374540 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:17.386051 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:17.397545 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:17.409101 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:17.420418 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:17.431785 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:17.443334 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:17.455033 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:29:17.572937 tst ping.py:19: start network... 08:29:17.776679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:18.247107 run create_hlr_db(pid=13525): Launched 08:29:18.371376 bus /gobi_6: Setting Powered False 08:29:19.431528 run create_hlr_db(pid=13525): Terminated: ok {rc=0} 08:29:19.875200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13527): Launched 08:29:20.200673 run osmo-hlr_10.42.42.2(pid=13528): Launched 08:29:20.324997 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:20.888126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13530): Launched 08:29:21.212089 run osmo-stp_10.42.42.5(pid=13531): Launched 08:29:21.335783 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:21.896446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13533): Launched 08:29:22.020270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:22.294620 run patchelf(pid=13534): Launched 08:29:22.477411 run osmo-stp_10.42.42.5(pid=13531): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13531)] 08:29:22.615277 run osmo-stp_10.42.42.5(pid=13531): stdout: | (launched: 2022-12-09_08:29:21.153147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:22.754857 run osmo-stp_10.42.42.5(pid=13531): stderr: | [0;m[38;5;43m20221209082921342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082921342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082921342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082921343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082921343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082921344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082921344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:22.894626 run osmo-stp_10.42.42.5(pid=13531): stdout: | (launched: 2022-12-09_08:29:21.153147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:23.028195 run osmo-stp_10.42.42.5(pid=13531): stderr: | [0;m[38;5;43m20221209082921342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082921342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082921342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082921343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082921343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082921344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082921344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:23.186410 run patchelf(pid=13534): Terminating (SIGINT) 08:29:23.368238 run patchelf(pid=13534): Terminated: ok {rc=0} 08:29:23.499849 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13531): Process ended prematurely: osmo-stp_10.42.42.5(pid=13531) [trial-2357↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13531)] [trial-2357↪gprs:sysmo↪ping.py:22] 08:29:23.509245 tst ping.py:22: Test FAILED (6.7 sec) 08:29:23.538075 run osmo-hlr_10.42.42.2(pid=13528): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13528)] 08:29:23.588809 run osmo-hlr_10.42.42.2(pid=13528): stdout: | (launched: 2022-12-09_08:29:20.141358) 08:29:23.641417 run osmo-hlr_10.42.42.2(pid=13528): stderr: | [0;m[1;31m20221209082920337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082920337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082920337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082920337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082920337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082920337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082920353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082920361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082920362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082920362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:23.694030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13527): Terminating (SIGTERM) 08:29:23.736891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13530): Terminating (SIGTERM) 08:29:23.779566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13533): Terminating (SIGTERM) 08:29:23.822571 --- ParallelTerminationStrategy: PID 13527 died... 08:29:23.842738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13527): Terminated: ok {rc=0} 08:29:23.890478 --- ParallelTerminationStrategy: PID 13530 died... 08:29:23.910504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13530): Terminated: ok {rc=0} 08:29:23.957889 --- ParallelTerminationStrategy: PID 13533 died... 08:29:23.977861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13533): Terminated: ok {rc=0} 08:29:24.066737 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 08:29:25.155196 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.166877 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:29:25.205367 tst ping_idle_ping.py: using LAC 20205 08:29:25.326209 tst ping_idle_ping.py: using RAC 60 08:29:25.445365 tst ping_idle_ping.py: using CellId 20205 08:29:25.564104 tst ping_idle_ping.py: using BVCI 20206 08:29:25.675221 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.686015 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.696708 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.707275 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.717721 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.728109 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.738674 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:29:25.749372 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:29:25.876783 tst ping_idle_ping.py:24: start network... 08:29:26.096599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:26.600466 run create_hlr_db(pid=13535): Launched 08:29:26.725640 bus /gobi_6: Setting Powered False 08:29:27.789481 run create_hlr_db(pid=13535): Terminated: ok {rc=0} 08:29:28.222990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13537): Launched 08:29:28.526036 run osmo-hlr_10.42.42.2(pid=13538): Launched 08:29:28.642414 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:29.178050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13540): Launched 08:29:29.480407 run osmo-stp_10.42.42.5(pid=13541): Launched 08:29:29.597264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:30.122121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13543): Launched 08:29:30.238334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:30.495030 run patchelf(pid=13544): Launched 08:29:30.663667 run osmo-stp_10.42.42.5(pid=13541): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13541)] 08:29:30.792173 run osmo-stp_10.42.42.5(pid=13541): stdout: | (launched: 2022-12-09_08:29:29.424821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:30.943284 run osmo-stp_10.42.42.5(pid=13541): stderr: | [0;m[38;5;43m20221209082929593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082929593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082929593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082929594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082929594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082929594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082929594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:31.086600 run osmo-stp_10.42.42.5(pid=13541): stdout: | (launched: 2022-12-09_08:29:29.424821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:31.214755 run osmo-stp_10.42.42.5(pid=13541): stderr: | [0;m[38;5;43m20221209082929593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082929593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082929593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082929594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082929594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082929594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082929594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:31.366472 run patchelf(pid=13544): Terminating (SIGINT) 08:29:31.541072 run patchelf(pid=13544): Terminated: ok {rc=0} 08:29:31.666023 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13541): Process ended prematurely: osmo-stp_10.42.42.5(pid=13541) [trial-2357↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13541)] [trial-2357↪gprs:sysmo↪ping_idle_ping.py:27] 08:29:31.675830 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:29:31.704315 run osmo-hlr_10.42.42.2(pid=13538): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13538)] 08:29:31.752926 run osmo-hlr_10.42.42.2(pid=13538): stdout: | (launched: 2022-12-09_08:29:28.470735) 08:29:31.802951 run osmo-hlr_10.42.42.2(pid=13538): stderr: | [0;m[1;31m20221209082928645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082928645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082928645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082928645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082928645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082928645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082928657 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082928665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082928666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082928666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:31.854151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13537): Terminating (SIGTERM) 08:29:31.895497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13540): Terminating (SIGTERM) 08:29:31.936400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13543): Terminating (SIGTERM) 08:29:31.978703 --- ParallelTerminationStrategy: PID 13537 died... 08:29:31.997852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13537): Terminated: ok {rc=0} 08:29:32.042959 --- ParallelTerminationStrategy: PID 13540 died... 08:29:32.062034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13540): Terminated: ok {rc=0} 08:29:32.107135 --- ParallelTerminationStrategy: PID 13543 died... 08:29:32.126625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13543): Terminated: ok {rc=0} 08:29:32.211038 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 08:29:33.494615 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:29:33.499811 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:29:33.520649 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:29:33.559801 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:29:33.650211 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:29:33.671510 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:29:33.710766 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:29:34.303250 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:29:34.352815 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.363776 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:29:34.401445 tst cs_paging_gprs_active.py: using LAC 20206 08:29:34.532769 tst cs_paging_gprs_active.py: using RAC 61 08:29:34.663238 tst cs_paging_gprs_active.py: using CellId 20206 08:29:34.795293 tst cs_paging_gprs_active.py: using BVCI 20207 08:29:34.918055 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.929956 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.941402 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.952851 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.964183 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.975757 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.987578 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:34.998991 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:35.010970 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:29:35.131390 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:29:35.250324 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:29:35.459781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:35.771523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13550): Launched 08:29:36.041378 run iperf3-srv_10.42.42.10(pid=13551): Launched 08:29:36.157368 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:29:36.364936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:36.676547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13552): Launched 08:29:36.945647 run iperf3-srv_10.42.42.10(pid=13553): Launched 08:29:37.061466 tst cs_paging_gprs_active.py:38: start network... 08:29:37.268515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:37.748106 run create_hlr_db(pid=13554): Launched 08:29:37.876276 bus /gobi_6: Setting Powered False 08:29:38.938009 run create_hlr_db(pid=13554): Terminated: ok {rc=0} 08:29:39.390396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13556): Launched 08:29:39.724059 run osmo-hlr_10.42.42.2(pid=13557): Launched 08:29:39.851000 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:40.422123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13559): Launched 08:29:40.754010 run osmo-stp_10.42.42.5(pid=13560): Launched 08:29:40.880750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:41.451849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13562): Launched 08:29:41.578975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:41.859060 run patchelf(pid=13563): Launched 08:29:42.044197 run osmo-stp_10.42.42.5(pid=13560): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13560)] 08:29:42.184038 run osmo-stp_10.42.42.5(pid=13560): stdout: | (launched: 2022-12-09_08:29:40.694026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:42.325415 run osmo-stp_10.42.42.5(pid=13560): stderr: | [0;m[38;5;43m20221209082940883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082940883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082940883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082940884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082940884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082940884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082940884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:42.467903 run osmo-stp_10.42.42.5(pid=13560): stdout: | (launched: 2022-12-09_08:29:40.694026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:42.604043 run osmo-stp_10.42.42.5(pid=13560): stderr: | [0;m[38;5;43m20221209082940883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082940883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082940883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082940884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082940884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082940884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082940884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:42.765057 run patchelf(pid=13563): Terminating (SIGINT) 08:29:42.950155 run patchelf(pid=13563): Terminated: ok {rc=0} 08:29:43.083719 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13560): Process ended prematurely: osmo-stp_10.42.42.5(pid=13560) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13560)] [trial-2357↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:29:43.094153 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:29:43.123492 run osmo-hlr_10.42.42.2(pid=13557): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13557)] 08:29:43.174210 run osmo-hlr_10.42.42.2(pid=13557): stdout: | (launched: 2022-12-09_08:29:39.664047) 08:29:43.226744 run osmo-hlr_10.42.42.2(pid=13557): stderr: | [0;m[1;31m20221209082939861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082939861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082939861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082939861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082939861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082939861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082939873 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082939882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082939882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082939882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:43.280127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13550): Terminating (SIGTERM) 08:29:43.322937 run iperf3-srv_10.42.42.10(pid=13551): Terminating (SIGTERM) 08:29:43.365397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13552): Terminating (SIGTERM) 08:29:43.408404 run iperf3-srv_10.42.42.10(pid=13553): Terminating (SIGTERM) 08:29:43.450862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13556): Terminating (SIGTERM) 08:29:43.493425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13559): Terminating (SIGTERM) 08:29:43.535836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13562): Terminating (SIGTERM) 08:29:43.578717 --- ParallelTerminationStrategy: PID 13550 died... 08:29:43.599031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13550): Terminated: ok {rc=0} 08:29:43.645993 --- ParallelTerminationStrategy: PID 13551 died... 08:29:43.665665 run iperf3-srv_10.42.42.10(pid=13551): Terminated {rc=256} 08:29:43.712410 --- ParallelTerminationStrategy: PID 13552 died... 08:29:43.732177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13552): Terminated: ok {rc=0} 08:29:43.778854 --- ParallelTerminationStrategy: PID 13553 died... 08:29:43.798528 run iperf3-srv_10.42.42.10(pid=13553): Terminated {rc=256} 08:29:43.845425 --- ParallelTerminationStrategy: PID 13556 died... 08:29:43.865084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13556): Terminated: ok {rc=0} 08:29:43.911872 --- ParallelTerminationStrategy: PID 13559 died... 08:29:43.931548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13559): Terminated: ok {rc=0} 08:29:43.978410 --- ParallelTerminationStrategy: PID 13562 died... 08:29:43.998080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13562): Terminated: ok {rc=0} 08:29:44.086198 bus /gobi_0: Setting Powered False 08:29:45.187543 bus /gobi_0: Setting Powered False 08:29:46.310068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:29:47.470715 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:47.482556 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:29:47.520863 tst iperf3.py: using LAC 20207 08:29:47.642200 tst iperf3.py: using RAC 62 08:29:47.765199 tst iperf3.py: using CellId 20207 08:29:47.888927 tst iperf3.py: using BVCI 20208 08:29:48.002686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.013885 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.024825 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.035766 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.046650 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.057468 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.068267 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.079077 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:48.090138 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:29:48.211237 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:29:48.419610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:48.729361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Launched 08:29:48.997343 run iperf3-srv_10.42.42.10(pid=13565): Launched 08:29:49.112574 tst iperf3.py:8: start network... 08:29:49.318893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:49.796433 run create_hlr_db(pid=13566): Launched 08:29:49.922610 bus /gobi_6: Setting Powered False 08:29:50.983690 run create_hlr_db(pid=13566): Terminated: ok {rc=0} 08:29:51.432719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13568): Launched 08:29:51.763160 run osmo-hlr_10.42.42.2(pid=13569): Launched 08:29:51.891262 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:52.459664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13571): Launched 08:29:52.789641 run osmo-stp_10.42.42.5(pid=13572): Launched 08:29:52.917601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:53.489561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13574): Launched 08:29:53.616856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:53.896651 run patchelf(pid=13575): Launched 08:29:54.079872 run osmo-stp_10.42.42.5(pid=13572): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13572)] 08:29:54.219643 run osmo-stp_10.42.42.5(pid=13572): stdout: | (launched: 2022-12-09_08:29:52.730001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:54.360884 run osmo-stp_10.42.42.5(pid=13572): stderr: | [0;m[38;5;43m20221209082952919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082952920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082952920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082952920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082952921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082952921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082952921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:54.502889 run osmo-stp_10.42.42.5(pid=13572): stdout: | (launched: 2022-12-09_08:29:52.730001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:54.638400 run osmo-stp_10.42.42.5(pid=13572): stderr: | [0;m[38;5;43m20221209082952919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209082952920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209082952920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209082952920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209082952921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209082952921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209082952921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:54.798835 run patchelf(pid=13575): Terminating (SIGINT) 08:29:54.983672 run patchelf(pid=13575): Terminated: ok {rc=0} 08:29:55.117185 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13572): Process ended prematurely: osmo-stp_10.42.42.5(pid=13572) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13572)] [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 08:29:55.127400 tst iperf3.py:8: Test FAILED (7.7 sec) 08:29:55.156448 run osmo-hlr_10.42.42.2(pid=13569): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13569)] 08:29:55.208201 run osmo-hlr_10.42.42.2(pid=13569): stdout: | (launched: 2022-12-09_08:29:51.703646) 08:29:55.261206 run osmo-hlr_10.42.42.2(pid=13569): stderr: | [0;m[1;31m20221209082951900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209082951900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209082951900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209082951900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209082951900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209082951900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209082951913 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209082951922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209082951922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209082951922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:55.314505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Terminating (SIGTERM) 08:29:55.357159 run iperf3-srv_10.42.42.10(pid=13565): Terminating (SIGTERM) 08:29:55.400178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13568): Terminating (SIGTERM) 08:29:55.443066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13571): Terminating (SIGTERM) 08:29:55.485780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13574): Terminating (SIGTERM) 08:29:55.528571 --- ParallelTerminationStrategy: PID 13564 died... 08:29:55.549012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Terminated: ok {rc=0} 08:29:55.596118 --- ParallelTerminationStrategy: PID 13565 died... 08:29:55.615757 run iperf3-srv_10.42.42.10(pid=13565): Terminated {rc=256} 08:29:55.662878 --- ParallelTerminationStrategy: PID 13568 died... 08:29:55.682656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13568): Terminated: ok {rc=0} 08:29:55.729763 --- ParallelTerminationStrategy: PID 13571 died... 08:29:55.749594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13571): Terminated: ok {rc=0} 08:29:55.796673 --- ParallelTerminationStrategy: PID 13574 died... 08:29:55.816496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13574): Terminated: ok {rc=0} 08:29:55.906339 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:29:57.059355 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.071563 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:29:57.110481 tst iperf3m4.py: using LAC 20208 08:29:57.241697 tst iperf3m4.py: using RAC 63 08:29:57.370250 tst iperf3m4.py: using CellId 20208 08:29:57.501171 tst iperf3m4.py: using BVCI 20209 08:29:57.621529 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.632933 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.644396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.655998 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.667511 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.678983 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.690760 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.702201 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:29:57.713906 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:29:57.835534 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:29:57.957671 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:29:58.074623 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:29:58.193716 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:29:58.402446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:58.715538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13576): Launched 08:29:58.985046 run iperf3-srv_10.42.42.10(pid=13577): Launched 08:29:59.100844 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:29:59.308114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:59.618379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13578): Launched 08:29:59.887289 run iperf3-srv_10.42.42.10(pid=13579): Launched 08:30:00.003066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:30:00.210765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:30:00.521243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13580): Launched 08:30:00.790459 run iperf3-srv_10.42.42.10(pid=13581): Launched 08:30:00.919805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:30:01.162061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:30:01.523221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13585): Launched 08:30:01.824637 run iperf3-srv_10.42.42.10(pid=13586): Launched 08:30:01.966545 tst iperf3m4.py:8: start network... 08:30:02.196866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:02.717381 run create_hlr_db(pid=13587): Launched 08:30:02.843217 bus /gobi_6: Setting Powered False 08:30:03.908521 run create_hlr_db(pid=13587): Terminated: ok {rc=0} 08:30:04.349676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Launched 08:30:04.659307 run osmo-hlr_10.42.42.2(pid=13590): Launched 08:30:04.780297 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:05.316394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Launched 08:30:05.625360 run osmo-stp_10.42.42.5(pid=13593): Launched 08:30:05.744223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:06.275368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13595): Launched 08:30:06.393314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:06.654502 run patchelf(pid=13596): Launched 08:30:06.827595 run osmo-stp_10.42.42.5(pid=13593): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] 08:30:06.958049 run osmo-stp_10.42.42.5(pid=13593): stdout: | (launched: 2022-12-09_08:30:05.568738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:07.089551 run osmo-stp_10.42.42.5(pid=13593): stderr: | [0;m[38;5;43m20221209083005739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083005739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083005739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083005740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083005740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083005740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083005740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:07.222066 run osmo-stp_10.42.42.5(pid=13593): stdout: | (launched: 2022-12-09_08:30:05.568738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:07.348158 run osmo-stp_10.42.42.5(pid=13593): stderr: | [0;m[38;5;43m20221209083005739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083005739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083005739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083005740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083005740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083005740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083005740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:07.498391 run patchelf(pid=13596): Terminating (SIGINT) 08:30:07.671343 run patchelf(pid=13596): Terminated: ok {rc=0} 08:30:07.795340 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13593): Process ended prematurely: osmo-stp_10.42.42.5(pid=13593) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 08:30:07.804751 tst iperf3m4.py:8: Test FAILED (10.8 sec) 08:30:07.832264 run osmo-hlr_10.42.42.2(pid=13590): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13590)] 08:30:07.879737 run osmo-hlr_10.42.42.2(pid=13590): stdout: | (launched: 2022-12-09_08:30:04.602444) 08:30:07.929127 run osmo-hlr_10.42.42.2(pid=13590): stderr: | [0;m[1;31m20221209083004777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083004777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083004777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083004777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083004777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083004777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083004789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083004797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083004797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083004798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:07.979033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13576): Terminating (SIGTERM) 08:30:08.018925 run iperf3-srv_10.42.42.10(pid=13577): Terminating (SIGTERM) 08:30:08.058529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13578): Terminating (SIGTERM) 08:30:08.098094 run iperf3-srv_10.42.42.10(pid=13579): Terminating (SIGTERM) 08:30:08.137631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13580): Terminating (SIGTERM) 08:30:08.177289 run iperf3-srv_10.42.42.10(pid=13581): Terminating (SIGTERM) 08:30:08.216789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13585): Terminating (SIGTERM) 08:30:08.256113 run iperf3-srv_10.42.42.10(pid=13586): Terminating (SIGTERM) 08:30:08.295367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Terminating (SIGTERM) 08:30:08.335358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Terminating (SIGTERM) 08:30:08.375032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13595): Terminating (SIGTERM) 08:30:08.415062 --- ParallelTerminationStrategy: PID 13576 died... 08:30:08.434309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13576): Terminated: ok {rc=0} 08:30:08.478682 --- ParallelTerminationStrategy: PID 13577 died... 08:30:08.497340 run iperf3-srv_10.42.42.10(pid=13577): Terminated {rc=256} 08:30:08.541246 --- ParallelTerminationStrategy: PID 13578 died... 08:30:08.559909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13578): Terminated: ok {rc=0} 08:30:08.604421 --- ParallelTerminationStrategy: PID 13579 died... 08:30:08.623313 run iperf3-srv_10.42.42.10(pid=13579): Terminated {rc=256} 08:30:08.667256 --- ParallelTerminationStrategy: PID 13580 died... 08:30:08.686129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13580): Terminated: ok {rc=0} 08:30:08.730522 --- ParallelTerminationStrategy: PID 13581 died... 08:30:08.749245 run iperf3-srv_10.42.42.10(pid=13581): Terminated {rc=256} 08:30:08.793811 --- ParallelTerminationStrategy: PID 13585 died... 08:30:08.812667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13585): Terminated: ok {rc=0} 08:30:08.857101 --- ParallelTerminationStrategy: PID 13586 died... 08:30:08.876073 run iperf3-srv_10.42.42.10(pid=13586): Terminated {rc=256} 08:30:08.920128 --- ParallelTerminationStrategy: PID 13589 died... 08:30:08.938899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13589): Terminated: ok {rc=0} 08:30:08.982774 --- ParallelTerminationStrategy: PID 13592 died... 08:30:09.001638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13592): Terminated: ok {rc=0} 08:30:09.045745 --- ParallelTerminationStrategy: PID 13595 died... 08:30:09.064637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13595): Terminated: ok {rc=0} 08:30:09.151564 bus /gobi_4: Setting Powered False 08:30:10.253580 bus /gobi_4: Setting Powered False 08:30:11.369477 bus /gobi_1: Setting Powered False 08:30:12.468408 bus /gobi_1: Setting Powered False 08:30:13.586010 bus /gobi_0: Setting Powered False 08:30:14.684628 bus /gobi_0: Setting Powered False 08:30:15.801454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 08:30:16.918709 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:16.931911 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:30:16.975070 tst ping.py: using LAC 20209 08:30:17.106074 tst ping.py: using RAC 64 08:30:17.239896 tst ping.py: using CellId 20209 08:30:17.366121 tst ping.py: using BVCI 20210 08:30:17.486537 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:17.498252 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:17.509983 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:17.521986 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:17.533811 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:17.545715 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:17.557527 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:17.569523 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:30:17.693296 tst ping.py:19: start network... 08:30:17.912844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:18.418460 run create_hlr_db(pid=13597): Launched 08:30:18.544677 bus /gobi_6: Setting Powered False 08:30:19.609218 run create_hlr_db(pid=13597): Terminated: ok {rc=0} 08:30:20.061993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13599): Launched 08:30:20.388633 run osmo-hlr_10.42.42.2(pid=13600): Launched 08:30:20.516013 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:21.075565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13602): Launched 08:30:21.400147 run osmo-stp_10.42.42.5(pid=13603): Launched 08:30:21.526576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:22.087388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13605): Launched 08:30:22.213589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:22.488152 run patchelf(pid=13606): Launched 08:30:22.668338 run osmo-stp_10.42.42.5(pid=13603): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13603)] 08:30:22.805667 run osmo-stp_10.42.42.5(pid=13603): stdout: | (launched: 2022-12-09_08:30:21.341216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:22.944413 run osmo-stp_10.42.42.5(pid=13603): stderr: | [0;m[38;5;43m20221209083021530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083021530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083021530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083021531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083021531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083021531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083021531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:23.083565 run osmo-stp_10.42.42.5(pid=13603): stdout: | (launched: 2022-12-09_08:30:21.341216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:23.217255 run osmo-stp_10.42.42.5(pid=13603): stderr: | [0;m[38;5;43m20221209083021530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083021530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083021530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083021531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083021531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083021531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083021531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:23.375501 run patchelf(pid=13606): Terminating (SIGINT) 08:30:23.557286 run patchelf(pid=13606): Terminated: ok {rc=0} 08:30:23.688162 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13603): Process ended prematurely: osmo-stp_10.42.42.5(pid=13603) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13603)] [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 08:30:23.697863 tst ping.py:22: Test FAILED (6.8 sec) 08:30:23.726975 run osmo-hlr_10.42.42.2(pid=13600): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13600)] 08:30:23.777730 run osmo-hlr_10.42.42.2(pid=13600): stdout: | (launched: 2022-12-09_08:30:20.329648) 08:30:23.830030 run osmo-hlr_10.42.42.2(pid=13600): stderr: | [0;m[1;31m20221209083020524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083020524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083020524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083020524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083020524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083020524 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083020536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083020545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083020545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083020545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:23.882716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13599): Terminating (SIGTERM) 08:30:23.925021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13602): Terminating (SIGTERM) 08:30:23.967185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13605): Terminating (SIGTERM) 08:30:24.009803 --- ParallelTerminationStrategy: PID 13599 died... 08:30:24.030067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13599): Terminated: ok {rc=0} 08:30:24.077371 --- ParallelTerminationStrategy: PID 13602 died... 08:30:24.097185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13602): Terminated: ok {rc=0} 08:30:24.144405 --- ParallelTerminationStrategy: PID 13605 died... 08:30:24.164309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13605): Terminated: ok {rc=0} 08:30:24.253292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:30:25.342546 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.355288 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:30:25.396082 tst ping_idle_ping.py: using LAC 20210 08:30:25.524924 tst ping_idle_ping.py: using RAC 65 08:30:25.652038 tst ping_idle_ping.py: using CellId 20210 08:30:25.779538 tst ping_idle_ping.py: using BVCI 20211 08:30:25.898192 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.909665 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.920828 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.932441 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.943935 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.955257 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.966901 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:30:25.978503 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:30:26.104332 tst ping_idle_ping.py:24: start network... 08:30:26.324512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:26.829203 run create_hlr_db(pid=13607): Launched 08:30:26.953192 bus /gobi_6: Setting Powered False 08:30:28.016879 run create_hlr_db(pid=13607): Terminated: ok {rc=0} 08:30:28.450216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Launched 08:30:28.754668 run osmo-hlr_10.42.42.2(pid=13610): Launched 08:30:28.870574 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:29.393310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Launched 08:30:29.697166 run osmo-stp_10.42.42.5(pid=13613): Launched 08:30:29.812941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:30.340230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Launched 08:30:30.457278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:30.713840 run patchelf(pid=13616): Launched 08:30:30.916647 run osmo-stp_10.42.42.5(pid=13613): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] 08:30:31.060616 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-09_08:30:29.641542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:31.204758 run osmo-stp_10.42.42.5(pid=13613): stderr: | [0;m[38;5;43m20221209083029808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083029808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083029808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083029809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083029809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083029809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083029809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:31.348065 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-09_08:30:29.641542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:31.487516 run osmo-stp_10.42.42.5(pid=13613): stderr: | [0;m[38;5;43m20221209083029808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083029808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083029808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083029809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083029809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083029809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083029809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:31.651792 run patchelf(pid=13616): Terminating (SIGINT) 08:30:31.841445 run patchelf(pid=13616): Terminated: ok {rc=0} 08:30:31.979518 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 08:30:31.990293 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:30:32.021757 run osmo-hlr_10.42.42.2(pid=13610): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13610)] 08:30:32.074295 run osmo-hlr_10.42.42.2(pid=13610): stdout: | (launched: 2022-12-09_08:30:28.698916) 08:30:32.128941 run osmo-hlr_10.42.42.2(pid=13610): stderr: | [0;m[1;31m20221209083028873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083028873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083028873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083028874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083028874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083028874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083028887 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083028898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083028898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083028898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:32.182406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminating (SIGTERM) 08:30:32.225393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminating (SIGTERM) 08:30:32.267639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Terminating (SIGTERM) 08:30:32.310172 --- ParallelTerminationStrategy: PID 13609 died... 08:30:32.330409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminated: ok {rc=0} 08:30:32.377266 --- ParallelTerminationStrategy: PID 13612 died... 08:30:32.396760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminated: ok {rc=0} 08:30:32.443983 --- ParallelTerminationStrategy: PID 13615 died... 08:30:32.463822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Terminated: ok {rc=0} 08:30:32.553131 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:30:33.849917 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:30:33.856447 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:30:33.878610 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:30:33.919432 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:30:34.011180 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:30:34.033454 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:30:34.074533 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:30:34.670876 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:30:34.724448 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:34.735905 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:30:34.794666 tst cs_paging_gprs_active.py: using LAC 20211 08:30:34.923907 tst cs_paging_gprs_active.py: using RAC 66 08:30:35.055004 tst cs_paging_gprs_active.py: using CellId 20211 08:30:35.185913 tst cs_paging_gprs_active.py: using BVCI 20212 08:30:35.307694 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.319394 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.330734 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.342309 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.353754 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.365240 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.376819 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.388216 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:35.399975 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:30:35.521428 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:30:35.642008 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:30:35.850842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:30:36.161953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13621): Launched 08:30:36.431526 run iperf3-srv_10.42.42.10(pid=13622): Launched 08:30:36.547006 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:30:36.753987 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:30:37.064915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13623): Launched 08:30:37.333701 run iperf3-srv_10.42.42.10(pid=13624): Launched 08:30:37.449587 tst cs_paging_gprs_active.py:38: start network... 08:30:37.656826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:38.135193 run create_hlr_db(pid=13625): Launched 08:30:38.262795 bus /gobi_6: Setting Powered False 08:30:39.324359 run create_hlr_db(pid=13625): Terminated: ok {rc=0} 08:30:39.754620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13627): Launched 08:30:40.064719 run osmo-hlr_10.42.42.2(pid=13628): Launched 08:30:40.183181 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:40.716446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13630): Launched 08:30:41.026781 run osmo-stp_10.42.42.5(pid=13631): Launched 08:30:41.144629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:41.677629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13633): Launched 08:30:41.795024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:42.055750 run patchelf(pid=13634): Launched 08:30:42.227819 run osmo-stp_10.42.42.5(pid=13631): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13631)] 08:30:42.359270 run osmo-stp_10.42.42.5(pid=13631): stdout: | (launched: 2022-12-09_08:30:40.970499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:42.492032 run osmo-stp_10.42.42.5(pid=13631): stderr: | [0;m[38;5;43m20221209083041138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083041138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083041138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083041139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083041139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083041139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083041139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:42.624341 run osmo-stp_10.42.42.5(pid=13631): stdout: | (launched: 2022-12-09_08:30:40.970499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:42.751283 run osmo-stp_10.42.42.5(pid=13631): stderr: | [0;m[38;5;43m20221209083041138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083041138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083041138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083041139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083041139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083041139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083041139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:42.901560 run patchelf(pid=13634): Terminating (SIGINT) 08:30:43.075170 run patchelf(pid=13634): Terminated: ok {rc=0} 08:30:43.199721 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13631): Process ended prematurely: osmo-stp_10.42.42.5(pid=13631) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13631)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:30:43.209212 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 08:30:43.236281 run osmo-hlr_10.42.42.2(pid=13628): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13628)] 08:30:43.283872 run osmo-hlr_10.42.42.2(pid=13628): stdout: | (launched: 2022-12-09_08:30:40.008196) 08:30:43.332913 run osmo-hlr_10.42.42.2(pid=13628): stderr: | [0;m[1;31m20221209083040184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083040184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083040184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083040184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083040184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083040184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083040196 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083040205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083040205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083040205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:43.382693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13621): Terminating (SIGTERM) 08:30:43.422538 run iperf3-srv_10.42.42.10(pid=13622): Terminating (SIGTERM) 08:30:43.462334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13623): Terminating (SIGTERM) 08:30:43.502319 run iperf3-srv_10.42.42.10(pid=13624): Terminating (SIGTERM) 08:30:43.542221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13627): Terminating (SIGTERM) 08:30:43.582201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13630): Terminating (SIGTERM) 08:30:43.622072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13633): Terminating (SIGTERM) 08:30:43.662144 --- ParallelTerminationStrategy: PID 13621 died... 08:30:43.681292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13621): Terminated: ok {rc=0} 08:30:43.725165 --- ParallelTerminationStrategy: PID 13622 died... 08:30:43.743677 run iperf3-srv_10.42.42.10(pid=13622): Terminated {rc=256} 08:30:43.788016 --- ParallelTerminationStrategy: PID 13623 died... 08:30:43.806679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13623): Terminated: ok {rc=0} 08:30:43.850142 --- ParallelTerminationStrategy: PID 13624 died... 08:30:43.868676 run iperf3-srv_10.42.42.10(pid=13624): Terminated {rc=256} 08:30:43.912209 --- ParallelTerminationStrategy: PID 13627 died... 08:30:43.930924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13627): Terminated: ok {rc=0} 08:30:43.974637 --- ParallelTerminationStrategy: PID 13630 died... 08:30:43.993282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13630): Terminated: ok {rc=0} 08:30:44.037375 --- ParallelTerminationStrategy: PID 13633 died... 08:30:44.056135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13633): Terminated: ok {rc=0} 08:30:44.139874 bus /gobi_0: Setting Powered False 08:30:45.238468 bus /gobi_0: Setting Powered False 08:30:46.361116 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:30:47.516478 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:47.528718 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:30:47.591529 tst iperf3.py: using LAC 20212 08:30:47.721394 tst iperf3.py: using RAC 67 08:30:47.850403 tst iperf3.py: using CellId 20212 08:30:47.979019 tst iperf3.py: using BVCI 20213 08:30:48.101108 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.112671 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.124037 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.135720 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.147146 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.158713 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.170616 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.182105 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:48.193793 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:30:48.313991 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:30:48.538316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:30:48.869463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Launched 08:30:49.157018 run iperf3-srv_10.42.42.10(pid=13636): Launched 08:30:49.281085 tst iperf3.py:8: start network... 08:30:49.505352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:50.019330 run create_hlr_db(pid=13637): Launched 08:30:50.146486 bus /gobi_6: Setting Powered False 08:30:51.211554 run create_hlr_db(pid=13637): Terminated: ok {rc=0} 08:30:51.671407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13639): Launched 08:30:52.002445 run osmo-hlr_10.42.42.2(pid=13640): Launched 08:30:52.131256 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:52.705446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13642): Launched 08:30:53.035114 run osmo-stp_10.42.42.5(pid=13643): Launched 08:30:53.163743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:53.733753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13645): Launched 08:30:53.859626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:54.138863 run patchelf(pid=13646): Launched 08:30:54.323797 run osmo-stp_10.42.42.5(pid=13643): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13643)] 08:30:54.464200 run osmo-stp_10.42.42.5(pid=13643): stdout: | (launched: 2022-12-09_08:30:52.975511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:54.605484 run osmo-stp_10.42.42.5(pid=13643): stderr: | [0;m[38;5;43m20221209083053163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083053163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083053164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083053164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083053165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083053165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083053165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:54.747051 run osmo-stp_10.42.42.5(pid=13643): stdout: | (launched: 2022-12-09_08:30:52.975511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:54.882629 run osmo-stp_10.42.42.5(pid=13643): stderr: | [0;m[38;5;43m20221209083053163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083053163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083053164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083053164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083053165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083053165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083053165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:55.043255 run patchelf(pid=13646): Terminating (SIGINT) 08:30:55.228175 run patchelf(pid=13646): Terminated: ok {rc=0} 08:30:55.361502 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13643): Process ended prematurely: osmo-stp_10.42.42.5(pid=13643) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13643)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 08:30:55.371664 tst iperf3.py:8: Test FAILED (7.9 sec) 08:30:55.401129 run osmo-hlr_10.42.42.2(pid=13640): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13640)] 08:30:55.452203 run osmo-hlr_10.42.42.2(pid=13640): stdout: | (launched: 2022-12-09_08:30:51.942593) 08:30:55.504801 run osmo-hlr_10.42.42.2(pid=13640): stderr: | [0;m[1;31m20221209083052137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083052137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083052137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083052137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083052138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083052138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083052151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083052159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083052159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083052159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:55.557815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Terminating (SIGTERM) 08:30:55.600295 run iperf3-srv_10.42.42.10(pid=13636): Terminating (SIGTERM) 08:30:55.642767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13639): Terminating (SIGTERM) 08:30:55.685283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13642): Terminating (SIGTERM) 08:30:55.727789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13645): Terminating (SIGTERM) 08:30:55.770398 --- ParallelTerminationStrategy: PID 13635 died... 08:30:55.790672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Terminated: ok {rc=0} 08:30:55.837792 --- ParallelTerminationStrategy: PID 13636 died... 08:30:55.857500 run iperf3-srv_10.42.42.10(pid=13636): Terminated {rc=256} 08:30:55.904622 --- ParallelTerminationStrategy: PID 13639 died... 08:30:55.924388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13639): Terminated: ok {rc=0} 08:30:55.971340 --- ParallelTerminationStrategy: PID 13642 died... 08:30:55.991132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13642): Terminated: ok {rc=0} 08:30:56.038220 --- ParallelTerminationStrategy: PID 13645 died... 08:30:56.058060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13645): Terminated: ok {rc=0} 08:30:56.147390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:30:57.300048 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.312224 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:30:57.374357 tst iperf3m4.py: using LAC 20213 08:30:57.495750 tst iperf3m4.py: using RAC 68 08:30:57.626478 tst iperf3m4.py: using CellId 20213 08:30:57.756759 tst iperf3m4.py: using BVCI 20214 08:30:57.877711 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.889483 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.900718 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.912629 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.924310 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.935937 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.947844 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.959259 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:30:57.971127 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:30:58.090636 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:30:58.217052 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:30:58.340927 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:30:58.460318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:30:58.669549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:30:58.981101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13647): Launched 08:30:59.250537 run iperf3-srv_10.42.42.10(pid=13648): Launched 08:30:59.366404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:30:59.574053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:30:59.884485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13649): Launched 08:31:00.154423 run iperf3-srv_10.42.42.10(pid=13650): Launched 08:31:00.272336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:31:00.480539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:00.790979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13651): Launched 08:31:01.095311 run iperf3-srv_10.42.42.10(pid=13652): Launched 08:31:01.227501 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:31:01.459153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:01.803229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13653): Launched 08:31:02.104192 run iperf3-srv_10.42.42.10(pid=13654): Launched 08:31:02.244763 tst iperf3m4.py:8: start network... 08:31:02.470082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:02.986526 run create_hlr_db(pid=13655): Launched 08:31:03.114862 bus /gobi_6: Setting Powered False 08:31:04.180007 run create_hlr_db(pid=13655): Terminated: ok {rc=0} 08:31:04.639998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13657): Launched 08:31:04.970888 run osmo-hlr_10.42.42.2(pid=13658): Launched 08:31:05.097328 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:05.670735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13660): Launched 08:31:06.002604 run osmo-stp_10.42.42.5(pid=13661): Launched 08:31:06.130561 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:06.702941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13663): Launched 08:31:06.830857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:07.110455 run patchelf(pid=13664): Launched 08:31:07.295185 run osmo-stp_10.42.42.5(pid=13661): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13661)] 08:31:07.435627 run osmo-stp_10.42.42.5(pid=13661): stdout: | (launched: 2022-12-09_08:31:05.942529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:07.577131 run osmo-stp_10.42.42.5(pid=13661): stderr: | [0;m[38;5;43m20221209083106130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083106130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083106130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083106130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083106131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083106131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083106131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:07.718349 run osmo-stp_10.42.42.5(pid=13661): stdout: | (launched: 2022-12-09_08:31:05.942529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:07.854256 run osmo-stp_10.42.42.5(pid=13661): stderr: | [0;m[38;5;43m20221209083106130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083106130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083106130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083106130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083106131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083106131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083106131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:08.015230 run patchelf(pid=13664): Terminating (SIGINT) 08:31:08.200590 run patchelf(pid=13664): Terminated: ok {rc=0} 08:31:08.334161 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13661): Process ended prematurely: osmo-stp_10.42.42.5(pid=13661) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13661)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:31:08.344372 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:31:08.373982 run osmo-hlr_10.42.42.2(pid=13658): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13658)] 08:31:08.425689 run osmo-hlr_10.42.42.2(pid=13658): stdout: | (launched: 2022-12-09_08:31:04.910987) 08:31:08.478853 run osmo-hlr_10.42.42.2(pid=13658): stderr: | [0;m[1;31m20221209083105106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083105106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083105106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083105106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083105106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083105106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083105119 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083105127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083105128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083105128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:08.531921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13647): Terminating (SIGTERM) 08:31:08.574718 run iperf3-srv_10.42.42.10(pid=13648): Terminating (SIGTERM) 08:31:08.617384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13649): Terminating (SIGTERM) 08:31:08.660215 run iperf3-srv_10.42.42.10(pid=13650): Terminating (SIGTERM) 08:31:08.703015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13651): Terminating (SIGTERM) 08:31:08.745725 run iperf3-srv_10.42.42.10(pid=13652): Terminating (SIGTERM) 08:31:08.788190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13653): Terminating (SIGTERM) 08:31:08.830845 run iperf3-srv_10.42.42.10(pid=13654): Terminating (SIGTERM) 08:31:08.873113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13657): Terminating (SIGTERM) 08:31:08.915711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13660): Terminating (SIGTERM) 08:31:08.958203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13663): Terminating (SIGTERM) 08:31:09.001085 --- ParallelTerminationStrategy: PID 13647 died... 08:31:09.021268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13647): Terminated: ok {rc=0} 08:31:09.068410 --- ParallelTerminationStrategy: PID 13648 died... 08:31:09.088176 run iperf3-srv_10.42.42.10(pid=13648): Terminated {rc=256} 08:31:09.135018 --- ParallelTerminationStrategy: PID 13649 died... 08:31:09.154940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13649): Terminated: ok {rc=0} 08:31:09.202033 --- ParallelTerminationStrategy: PID 13650 died... 08:31:09.221859 run iperf3-srv_10.42.42.10(pid=13650): Terminated {rc=256} 08:31:09.268650 --- ParallelTerminationStrategy: PID 13651 died... 08:31:09.288356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13651): Terminated: ok {rc=0} 08:31:09.335587 --- ParallelTerminationStrategy: PID 13652 died... 08:31:09.355487 run iperf3-srv_10.42.42.10(pid=13652): Terminated {rc=256} 08:31:09.402562 --- ParallelTerminationStrategy: PID 13653 died... 08:31:09.422401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13653): Terminated: ok {rc=0} 08:31:09.469715 --- ParallelTerminationStrategy: PID 13654 died... 08:31:09.489771 run iperf3-srv_10.42.42.10(pid=13654): Terminated {rc=256} 08:31:09.536713 --- ParallelTerminationStrategy: PID 13657 died... 08:31:09.556721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13657): Terminated: ok {rc=0} 08:31:09.603947 --- ParallelTerminationStrategy: PID 13660 died... 08:31:09.623829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13660): Terminated: ok {rc=0} 08:31:09.671675 --- ParallelTerminationStrategy: PID 13663 died... 08:31:09.691663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13663): Terminated: ok {rc=0} 08:31:09.781283 bus /gobi_4: Setting Powered False 08:31:10.881316 bus /gobi_4: Setting Powered False 08:31:12.000353 bus /gobi_1: Setting Powered False 08:31:13.099831 bus /gobi_1: Setting Powered False 08:31:14.218038 bus /gobi_0: Setting Powered False 08:31:15.316295 bus /gobi_0: Setting Powered False 08:31:16.438781 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:31:17.553136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:17.565475 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:31:17.625409 tst ping.py: using LAC 20214 08:31:17.754307 tst ping.py: using RAC 69 08:31:17.882416 tst ping.py: using CellId 20214 08:31:18.010516 tst ping.py: using BVCI 20215 08:31:18.122573 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:18.133914 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:18.145060 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:18.156010 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:18.166974 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:18.177995 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:18.189234 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:18.200230 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:31:18.322259 tst ping.py:19: start network... 08:31:18.543011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:19.048597 run create_hlr_db(pid=13665): Launched 08:31:19.173563 bus /gobi_6: Setting Powered False 08:31:20.238423 run create_hlr_db(pid=13665): Terminated: ok {rc=0} 08:31:20.675675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13667): Launched 08:31:20.980751 run osmo-hlr_10.42.42.2(pid=13668): Launched 08:31:21.096455 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:21.646291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13670): Launched 08:31:21.951932 run osmo-stp_10.42.42.5(pid=13671): Launched 08:31:22.067110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:22.591839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13673): Launched 08:31:22.708025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:22.964522 run patchelf(pid=13674): Launched 08:31:23.132812 run osmo-stp_10.42.42.5(pid=13671): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13671)] 08:31:23.260782 run osmo-stp_10.42.42.5(pid=13671): stdout: | (launched: 2022-12-09_08:31:21.895549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:23.391053 run osmo-stp_10.42.42.5(pid=13671): stderr: | [0;m[38;5;43m20221209083122064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083122064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083122064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083122065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083122065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083122066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083122066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:23.521606 run osmo-stp_10.42.42.5(pid=13671): stdout: | (launched: 2022-12-09_08:31:21.895549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:23.646389 run osmo-stp_10.42.42.5(pid=13671): stderr: | [0;m[38;5;43m20221209083122064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083122064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083122064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083122065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083122065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083122066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083122066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:23.794162 run patchelf(pid=13674): Terminating (SIGINT) 08:31:23.963727 run patchelf(pid=13674): Terminated: ok {rc=0} 08:31:24.086129 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13671): Process ended prematurely: osmo-stp_10.42.42.5(pid=13671) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13671)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 08:31:24.095192 tst ping.py:22: Test FAILED (6.5 sec) 08:31:24.122617 run osmo-hlr_10.42.42.2(pid=13668): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13668)] 08:31:24.170689 run osmo-hlr_10.42.42.2(pid=13668): stdout: | (launched: 2022-12-09_08:31:20.924802) 08:31:24.220101 run osmo-hlr_10.42.42.2(pid=13668): stderr: | [0;m[1;31m20221209083121100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083121100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083121100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083121100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083121100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083121100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083121112 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083121122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083121123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083121123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:24.270017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13667): Terminating (SIGTERM) 08:31:24.310218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13670): Terminating (SIGTERM) 08:31:24.350409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13673): Terminating (SIGTERM) 08:31:24.390918 --- ParallelTerminationStrategy: PID 13667 died... 08:31:24.410090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13667): Terminated: ok {rc=0} 08:31:24.454184 --- ParallelTerminationStrategy: PID 13670 died... 08:31:24.473089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13670): Terminated: ok {rc=0} 08:31:24.517486 --- ParallelTerminationStrategy: PID 13673 died... 08:31:24.536396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13673): Terminated: ok {rc=0} 08:31:24.623971 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:31:25.711795 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:25.723509 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:31:25.782394 tst ping_idle_ping.py: using LAC 20215 08:31:25.903446 tst ping_idle_ping.py: using RAC 70 08:31:26.025148 tst ping_idle_ping.py: using CellId 20215 08:31:26.144430 tst ping_idle_ping.py: using BVCI 20216 08:31:26.254828 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:26.265906 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:26.276713 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:26.287658 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:26.298601 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:26.309496 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:26.320840 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:31:26.331798 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:31:26.447825 tst ping_idle_ping.py:24: start network... 08:31:26.652507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:27.127666 run create_hlr_db(pid=13675): Launched 08:31:27.252188 bus /gobi_6: Setting Powered False 08:31:28.312438 run create_hlr_db(pid=13675): Terminated: ok {rc=0} 08:31:28.759862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13677): Launched 08:31:29.086832 run osmo-hlr_10.42.42.2(pid=13678): Launched 08:31:29.214361 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:29.778111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13680): Launched 08:31:30.105264 run osmo-stp_10.42.42.5(pid=13681): Launched 08:31:30.231843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:30.797480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13683): Launched 08:31:30.944529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:31.230791 run patchelf(pid=13684): Launched 08:31:31.434874 run osmo-stp_10.42.42.5(pid=13681): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13681)] 08:31:31.578985 run osmo-stp_10.42.42.5(pid=13681): stdout: | (launched: 2022-12-09_08:31:30.045884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:31.722114 run osmo-stp_10.42.42.5(pid=13681): stderr: | [0;m[38;5;43m20221209083130235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083130235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083130235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083130236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083130236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083130236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083130236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:31.865392 run osmo-stp_10.42.42.5(pid=13681): stdout: | (launched: 2022-12-09_08:31:30.045884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:32.003276 run osmo-stp_10.42.42.5(pid=13681): stderr: | [0;m[38;5;43m20221209083130235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083130235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083130235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083130236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083130236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083130236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083130236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:32.166112 run patchelf(pid=13684): Terminating (SIGINT) 08:31:32.350768 run patchelf(pid=13684): Terminated: ok {rc=0} 08:31:32.483724 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13681): Process ended prematurely: osmo-stp_10.42.42.5(pid=13681) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13681)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:31:32.493734 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:31:32.522755 run osmo-hlr_10.42.42.2(pid=13678): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13678)] 08:31:32.574094 run osmo-hlr_10.42.42.2(pid=13678): stdout: | (launched: 2022-12-09_08:31:29.027518) 08:31:32.626877 run osmo-hlr_10.42.42.2(pid=13678): stderr: | [0;m[1;31m20221209083129223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083129223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083129223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083129224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083129224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083129224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083129235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083129244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083129244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083129244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:32.680368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13677): Terminating (SIGTERM) 08:31:32.723171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13680): Terminating (SIGTERM) 08:31:32.765620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13683): Terminating (SIGTERM) 08:31:32.809222 --- ParallelTerminationStrategy: PID 13677 died... 08:31:32.829519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13677): Terminated: ok {rc=0} 08:31:32.876739 --- ParallelTerminationStrategy: PID 13680 died... 08:31:32.896649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13680): Terminated: ok {rc=0} 08:31:32.944061 --- ParallelTerminationStrategy: PID 13683 died... 08:31:32.964081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13683): Terminated: ok {rc=0} 08:31:33.054224 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:31:34.351405 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:31:34.358726 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:31:34.380843 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:31:34.421021 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:31:34.508650 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:31:34.529719 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:31:34.569511 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:31:35.166133 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:31:35.217342 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.228494 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:31:35.286122 tst cs_paging_gprs_active.py: using LAC 20216 08:31:35.407183 tst cs_paging_gprs_active.py: using RAC 71 08:31:35.526952 tst cs_paging_gprs_active.py: using CellId 20216 08:31:35.648190 tst cs_paging_gprs_active.py: using BVCI 20217 08:31:35.760824 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.772076 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.782871 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.793692 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.804530 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.815487 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.826407 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.837197 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:35.848180 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:31:35.965954 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:31:36.089854 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:31:36.315247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:36.649465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13688): Launched 08:31:36.937958 run iperf3-srv_10.42.42.10(pid=13689): Launched 08:31:37.062527 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:31:37.286774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:37.620308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13690): Launched 08:31:37.907403 run iperf3-srv_10.42.42.10(pid=13691): Launched 08:31:38.031577 tst cs_paging_gprs_active.py:38: start network... 08:31:38.255843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:38.770213 run create_hlr_db(pid=13692): Launched 08:31:38.899307 bus /gobi_6: Setting Powered False 08:31:39.964279 run create_hlr_db(pid=13692): Terminated: ok {rc=0} 08:31:40.405865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13694): Launched 08:31:40.716038 run osmo-hlr_10.42.42.2(pid=13695): Launched 08:31:40.834462 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:41.380290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13697): Launched 08:31:41.689119 run osmo-stp_10.42.42.5(pid=13698): Launched 08:31:41.806637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:42.340387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13700): Launched 08:31:42.459215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:42.720777 run patchelf(pid=13701): Launched 08:31:42.893909 run osmo-stp_10.42.42.5(pid=13698): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13698)] 08:31:43.024800 run osmo-stp_10.42.42.5(pid=13698): stdout: | (launched: 2022-12-09_08:31:41.632687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:43.157439 run osmo-stp_10.42.42.5(pid=13698): stderr: | [0;m[38;5;43m20221209083141800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083141800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083141800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083141801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083141801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083141801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083141801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:43.289819 run osmo-stp_10.42.42.5(pid=13698): stdout: | (launched: 2022-12-09_08:31:41.632687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:43.416886 run osmo-stp_10.42.42.5(pid=13698): stderr: | [0;m[38;5;43m20221209083141800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083141800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083141800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083141801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083141801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083141801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083141801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:43.567212 run patchelf(pid=13701): Terminating (SIGINT) 08:31:43.740782 run patchelf(pid=13701): Terminated: ok {rc=0} 08:31:43.866019 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13698): Process ended prematurely: osmo-stp_10.42.42.5(pid=13698) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13698)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:31:43.875420 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:31:43.902770 run osmo-hlr_10.42.42.2(pid=13695): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13695)] 08:31:43.950404 run osmo-hlr_10.42.42.2(pid=13695): stdout: | (launched: 2022-12-09_08:31:40.659403) 08:31:43.999829 run osmo-hlr_10.42.42.2(pid=13695): stderr: | [0;m[1;31m20221209083140834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083140834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083140834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083140834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083140834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083140835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083140846 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083140855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083140855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083140855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:44.049613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13688): Terminating (SIGTERM) 08:31:44.089754 run iperf3-srv_10.42.42.10(pid=13689): Terminating (SIGTERM) 08:31:44.129725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13690): Terminating (SIGTERM) 08:31:44.169843 run iperf3-srv_10.42.42.10(pid=13691): Terminating (SIGTERM) 08:31:44.209664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13694): Terminating (SIGTERM) 08:31:44.249622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13697): Terminating (SIGTERM) 08:31:44.289541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13700): Terminating (SIGTERM) 08:31:44.329704 --- ParallelTerminationStrategy: PID 13688 died... 08:31:44.348929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13688): Terminated: ok {rc=0} 08:31:44.393377 --- ParallelTerminationStrategy: PID 13689 died... 08:31:44.412001 run iperf3-srv_10.42.42.10(pid=13689): Terminated {rc=256} 08:31:44.456140 --- ParallelTerminationStrategy: PID 13690 died... 08:31:44.474847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13690): Terminated: ok {rc=0} 08:31:44.519012 --- ParallelTerminationStrategy: PID 13691 died... 08:31:44.537775 run iperf3-srv_10.42.42.10(pid=13691): Terminated {rc=256} 08:31:44.581582 --- ParallelTerminationStrategy: PID 13694 died... 08:31:44.600249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13694): Terminated: ok {rc=0} 08:31:44.644287 --- ParallelTerminationStrategy: PID 13697 died... 08:31:44.663175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13697): Terminated: ok {rc=0} 08:31:44.706955 --- ParallelTerminationStrategy: PID 13700 died... 08:31:44.725754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13700): Terminated: ok {rc=0} 08:31:44.812140 bus /gobi_0: Setting Powered False 08:31:45.930678 bus /gobi_0: Setting Powered False 08:31:47.075408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:31:48.241379 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.253785 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:31:48.317354 tst iperf3.py: using LAC 20217 08:31:48.448838 tst iperf3.py: using RAC 72 08:31:48.571806 tst iperf3.py: using CellId 20217 08:31:48.695651 tst iperf3.py: using BVCI 20218 08:31:48.809395 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.820592 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.831693 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.843277 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.854786 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.866290 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.877776 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.889111 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:48.900595 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:31:49.024109 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:31:49.250856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:49.585173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13702): Launched 08:31:49.874185 run iperf3-srv_10.42.42.10(pid=13703): Launched 08:31:50.000403 tst iperf3.py:8: start network... 08:31:50.225483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:50.742391 run create_hlr_db(pid=13704): Launched 08:31:50.871337 bus /gobi_6: Setting Powered False 08:31:51.936308 run create_hlr_db(pid=13704): Terminated: ok {rc=0} 08:31:52.394906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Launched 08:31:52.728577 run osmo-hlr_10.42.42.2(pid=13707): Launched 08:31:52.856046 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:53.430251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Launched 08:31:53.763028 run osmo-stp_10.42.42.5(pid=13710): Launched 08:31:53.891305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:31:54.463806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13712): Launched 08:31:54.590915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:31:54.872180 run patchelf(pid=13713): Launched 08:31:55.056195 run osmo-stp_10.42.42.5(pid=13710): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] 08:31:55.196167 run osmo-stp_10.42.42.5(pid=13710): stdout: | (launched: 2022-12-09_08:31:53.703058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:55.338188 run osmo-stp_10.42.42.5(pid=13710): stderr: | [0;m[38;5;43m20221209083153893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083153893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083153893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083153894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083153894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083153894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083153894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:55.480701 run osmo-stp_10.42.42.5(pid=13710): stdout: | (launched: 2022-12-09_08:31:53.703058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:55.616739 run osmo-stp_10.42.42.5(pid=13710): stderr: | [0;m[38;5;43m20221209083153893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083153893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083153893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083153894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083153894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083153894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083153894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:55.778076 run patchelf(pid=13713): Terminating (SIGINT) 08:31:55.963927 run patchelf(pid=13713): Terminated: ok {rc=0} 08:31:56.098104 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13710): Process ended prematurely: osmo-stp_10.42.42.5(pid=13710) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 08:31:56.108894 tst iperf3.py:8: Test FAILED (7.9 sec) 08:31:56.138257 run osmo-hlr_10.42.42.2(pid=13707): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13707)] 08:31:56.188910 run osmo-hlr_10.42.42.2(pid=13707): stdout: | (launched: 2022-12-09_08:31:52.668459) 08:31:56.241614 run osmo-hlr_10.42.42.2(pid=13707): stderr: | [0;m[1;31m20221209083152866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083152866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083152866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083152866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083152866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083152866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083152882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083152891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083152892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083152892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:56.294534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13702): Terminating (SIGTERM) 08:31:56.337152 run iperf3-srv_10.42.42.10(pid=13703): Terminating (SIGTERM) 08:31:56.379648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Terminating (SIGTERM) 08:31:56.422371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Terminating (SIGTERM) 08:31:56.465296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13712): Terminating (SIGTERM) 08:31:56.508417 --- ParallelTerminationStrategy: PID 13702 died... 08:31:56.528768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13702): Terminated: ok {rc=0} 08:31:56.576688 --- ParallelTerminationStrategy: PID 13703 died... 08:31:56.596664 run iperf3-srv_10.42.42.10(pid=13703): Terminated {rc=256} 08:31:56.643483 --- ParallelTerminationStrategy: PID 13706 died... 08:31:56.663295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Terminated: ok {rc=0} 08:31:56.710391 --- ParallelTerminationStrategy: PID 13709 died... 08:31:56.730220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Terminated: ok {rc=0} 08:31:56.777419 --- ParallelTerminationStrategy: PID 13712 died... 08:31:56.797447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13712): Terminated: ok {rc=0} 08:31:56.887286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:31:58.039893 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.052235 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:31:58.112672 tst iperf3m4.py: using LAC 20218 08:31:58.238831 tst iperf3m4.py: using RAC 73 08:31:58.361575 tst iperf3m4.py: using CellId 20218 08:31:58.483947 tst iperf3m4.py: using BVCI 20219 08:31:58.596620 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.607915 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.619073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.630171 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.641117 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.652078 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.663181 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.674130 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:31:58.685306 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:31:58.806080 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:31:58.931349 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:31:59.054119 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:31:59.180070 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:31:59.389174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:31:59.700638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13715): Launched 08:31:59.970070 run iperf3-srv_10.42.42.10(pid=13716): Launched 08:32:00.087923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:32:00.294830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:00.605559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13717): Launched 08:32:00.897705 run iperf3-srv_10.42.42.10(pid=13718): Launched 08:32:01.043078 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:32:01.253679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:01.572914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13719): Launched 08:32:01.858552 run iperf3-srv_10.42.42.10(pid=13720): Launched 08:32:01.991556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:32:02.201937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:32:02.514075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13721): Launched 08:32:02.784787 run iperf3-srv_10.42.42.10(pid=13722): Launched 08:32:02.901113 tst iperf3m4.py:8: start network... 08:32:03.108438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:03.589536 run create_hlr_db(pid=13723): Launched 08:32:03.714799 bus /gobi_6: Setting Powered False 08:32:04.775685 run create_hlr_db(pid=13723): Terminated: ok {rc=0} 08:32:05.206559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13725): Launched 08:32:05.516016 run osmo-hlr_10.42.42.2(pid=13726): Launched 08:32:05.634304 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:06.186516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13728): Launched 08:32:06.497220 run osmo-stp_10.42.42.5(pid=13729): Launched 08:32:06.615449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:07.148893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13731): Launched 08:32:07.269502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:07.532144 run patchelf(pid=13732): Launched 08:32:07.705414 run osmo-stp_10.42.42.5(pid=13729): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13729)] 08:32:07.837122 run osmo-stp_10.42.42.5(pid=13729): stdout: | (launched: 2022-12-09_08:32:06.440679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:07.970238 run osmo-stp_10.42.42.5(pid=13729): stderr: | [0;m[38;5;43m20221209083206610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083206610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083206610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083206611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083206611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083206611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083206611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:08.103335 run osmo-stp_10.42.42.5(pid=13729): stdout: | (launched: 2022-12-09_08:32:06.440679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:08.230685 run osmo-stp_10.42.42.5(pid=13729): stderr: | [0;m[38;5;43m20221209083206610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083206610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083206610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083206611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083206611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083206611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083206611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:08.381625 run patchelf(pid=13732): Terminating (SIGINT) 08:32:08.555820 run patchelf(pid=13732): Terminated: ok {rc=0} 08:32:08.681396 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13729): Process ended prematurely: osmo-stp_10.42.42.5(pid=13729) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13729)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:32:08.690969 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:32:08.718675 run osmo-hlr_10.42.42.2(pid=13726): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13726)] 08:32:08.766412 run osmo-hlr_10.42.42.2(pid=13726): stdout: | (launched: 2022-12-09_08:32:05.459331) 08:32:08.816066 run osmo-hlr_10.42.42.2(pid=13726): stderr: | [0;m[1;31m20221209083205634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083205634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083205634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083205634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083205634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083205635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083205647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083205655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083205655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083205655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:08.866287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13715): Terminating (SIGTERM) 08:32:08.906394 run iperf3-srv_10.42.42.10(pid=13716): Terminating (SIGTERM) 08:32:08.947233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13717): Terminating (SIGTERM) 08:32:08.988086 run iperf3-srv_10.42.42.10(pid=13718): Terminating (SIGTERM) 08:32:09.028783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13719): Terminating (SIGTERM) 08:32:09.069774 run iperf3-srv_10.42.42.10(pid=13720): Terminating (SIGTERM) 08:32:09.110255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13721): Terminating (SIGTERM) 08:32:09.150622 run iperf3-srv_10.42.42.10(pid=13722): Terminating (SIGTERM) 08:32:09.190727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13725): Terminating (SIGTERM) 08:32:09.230995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13728): Terminating (SIGTERM) 08:32:09.271298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13731): Terminating (SIGTERM) 08:32:09.312049 --- ParallelTerminationStrategy: PID 13715 died... 08:32:09.331522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13715): Terminated: ok {rc=0} 08:32:09.376220 --- ParallelTerminationStrategy: PID 13716 died... 08:32:09.395150 run iperf3-srv_10.42.42.10(pid=13716): Terminated {rc=256} 08:32:09.439652 --- ParallelTerminationStrategy: PID 13717 died... 08:32:09.458772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13717): Terminated: ok {rc=0} 08:32:09.503707 --- ParallelTerminationStrategy: PID 13718 died... 08:32:09.522713 run iperf3-srv_10.42.42.10(pid=13718): Terminated {rc=256} 08:32:09.567302 --- ParallelTerminationStrategy: PID 13719 died... 08:32:09.586315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13719): Terminated: ok {rc=0} 08:32:09.631255 --- ParallelTerminationStrategy: PID 13720 died... 08:32:09.650290 run iperf3-srv_10.42.42.10(pid=13720): Terminated {rc=256} 08:32:09.695009 --- ParallelTerminationStrategy: PID 13721 died... 08:32:09.713974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13721): Terminated: ok {rc=0} 08:32:09.758557 --- ParallelTerminationStrategy: PID 13722 died... 08:32:09.777651 run iperf3-srv_10.42.42.10(pid=13722): Terminated {rc=256} 08:32:09.822291 --- ParallelTerminationStrategy: PID 13725 died... 08:32:09.841452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13725): Terminated: ok {rc=0} 08:32:09.886049 --- ParallelTerminationStrategy: PID 13728 died... 08:32:09.905057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13728): Terminated: ok {rc=0} 08:32:09.949794 --- ParallelTerminationStrategy: PID 13731 died... 08:32:09.968761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13731): Terminated: ok {rc=0} 08:32:10.055045 bus /gobi_4: Setting Powered False 08:32:11.155956 bus /gobi_4: Setting Powered False 08:32:12.272643 bus /gobi_1: Setting Powered False 08:32:13.372344 bus /gobi_1: Setting Powered False 08:32:14.488569 bus /gobi_0: Setting Powered False 08:32:15.587824 bus /gobi_0: Setting Powered False 08:32:16.715089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:32:17.823187 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:17.835232 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:32:17.896294 tst ping.py: using LAC 20219 08:32:18.017337 tst ping.py: using RAC 74 08:32:18.137344 tst ping.py: using CellId 20219 08:32:18.257080 tst ping.py: using BVCI 20220 08:32:18.367596 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:18.379001 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:18.389980 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:18.401086 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:18.411997 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:18.422901 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:18.434220 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:18.445241 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:32:18.566044 tst ping.py:19: start network... 08:32:18.786576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:19.293321 run create_hlr_db(pid=13733): Launched 08:32:19.420514 bus /gobi_6: Setting Powered False 08:32:20.485991 run create_hlr_db(pid=13733): Terminated: ok {rc=0} 08:32:20.940644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13735): Launched 08:32:21.268110 run osmo-hlr_10.42.42.2(pid=13736): Launched 08:32:21.393963 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:21.960403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13738): Launched 08:32:22.288170 run osmo-stp_10.42.42.5(pid=13739): Launched 08:32:22.414358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:22.979206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13741): Launched 08:32:23.106246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:23.382416 run patchelf(pid=13742): Launched 08:32:23.565715 run osmo-stp_10.42.42.5(pid=13739): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13739)] 08:32:23.703870 run osmo-stp_10.42.42.5(pid=13739): stdout: | (launched: 2022-12-09_08:32:22.228349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:23.843387 run osmo-stp_10.42.42.5(pid=13739): stderr: | [0;m[38;5;43m20221209083222420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083222420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083222421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083222421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083222421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083222422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083222422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:23.983073 run osmo-stp_10.42.42.5(pid=13739): stdout: | (launched: 2022-12-09_08:32:22.228349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:24.117574 run osmo-stp_10.42.42.5(pid=13739): stderr: | [0;m[38;5;43m20221209083222420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083222420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083222421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083222421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083222421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083222422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083222422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:24.276084 run patchelf(pid=13742): Terminating (SIGINT) 08:32:24.458979 run patchelf(pid=13742): Terminated: ok {rc=0} 08:32:24.591466 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13739): Process ended prematurely: osmo-stp_10.42.42.5(pid=13739) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13739)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 08:32:24.601207 tst ping.py:22: Test FAILED (6.8 sec) 08:32:24.630191 run osmo-hlr_10.42.42.2(pid=13736): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13736)] 08:32:24.681376 run osmo-hlr_10.42.42.2(pid=13736): stdout: | (launched: 2022-12-09_08:32:21.208325) 08:32:24.734148 run osmo-hlr_10.42.42.2(pid=13736): stderr: | [0;m[1;31m20221209083221406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083221406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083221406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083221406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083221407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083221407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083221420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083221430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083221430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083221430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:24.787224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13735): Terminating (SIGTERM) 08:32:24.829927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13738): Terminating (SIGTERM) 08:32:24.872535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13741): Terminating (SIGTERM) 08:32:24.915878 --- ParallelTerminationStrategy: PID 13735 died... 08:32:24.936160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13735): Terminated: ok {rc=0} 08:32:24.983367 --- ParallelTerminationStrategy: PID 13738 died... 08:32:25.003226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13738): Terminated: ok {rc=0} 08:32:25.050488 --- ParallelTerminationStrategy: PID 13741 died... 08:32:25.070383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13741): Terminated: ok {rc=0} 08:32:25.159895 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:32:26.246722 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.258717 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:32:26.317689 tst ping_idle_ping.py: using LAC 20220 08:32:26.444554 tst ping_idle_ping.py: using RAC 75 08:32:26.564161 tst ping_idle_ping.py: using CellId 20220 08:32:26.683056 tst ping_idle_ping.py: using BVCI 20221 08:32:26.794593 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.806056 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.817286 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.828590 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.839813 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.851017 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.862509 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:32:26.873771 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:32:26.994489 tst ping_idle_ping.py:24: start network... 08:32:27.217630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:27.732435 run create_hlr_db(pid=13743): Launched 08:32:27.858391 bus /gobi_6: Setting Powered False 08:32:28.919188 run create_hlr_db(pid=13743): Terminated: ok {rc=0} 08:32:29.377614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Launched 08:32:29.706874 run osmo-hlr_10.42.42.2(pid=13746): Launched 08:32:29.835105 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:30.400699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Launched 08:32:30.730491 run osmo-stp_10.42.42.5(pid=13749): Launched 08:32:30.901686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:31.555561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13751): Launched 08:32:31.688728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:31.956794 run patchelf(pid=13752): Launched 08:32:32.147951 run osmo-stp_10.42.42.5(pid=13749): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] 08:32:32.282981 run osmo-stp_10.42.42.5(pid=13749): stdout: | (launched: 2022-12-09_08:32:30.670246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:32.424558 run osmo-stp_10.42.42.5(pid=13749): stderr: | [0;m[38;5;43m20221209083230883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083230883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083230883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083230884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083230884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083230884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083230884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:32.565873 run osmo-stp_10.42.42.5(pid=13749): stdout: | (launched: 2022-12-09_08:32:30.670246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:32.700505 run osmo-stp_10.42.42.5(pid=13749): stderr: | [0;m[38;5;43m20221209083230883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083230883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083230883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083230884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083230884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083230884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083230884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:32.860464 run patchelf(pid=13752): Terminating (SIGINT) 08:32:33.044264 run patchelf(pid=13752): Terminated: ok {rc=0} 08:32:33.177626 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13749): Process ended prematurely: osmo-stp_10.42.42.5(pid=13749) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:32:33.187594 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 08:32:33.216700 run osmo-hlr_10.42.42.2(pid=13746): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13746)] 08:32:33.268002 run osmo-hlr_10.42.42.2(pid=13746): stdout: | (launched: 2022-12-09_08:32:29.646744) 08:32:33.320909 run osmo-hlr_10.42.42.2(pid=13746): stderr: | [0;m[1;31m20221209083229846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083229846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083229846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083229846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083229846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083229846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083229858 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083229866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083229866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083229866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:33.374513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Terminating (SIGTERM) 08:32:33.417099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Terminating (SIGTERM) 08:32:33.460080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13751): Terminating (SIGTERM) 08:32:33.504068 --- ParallelTerminationStrategy: PID 13745 died... 08:32:33.524634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13745): Terminated: ok {rc=0} 08:32:33.572366 --- ParallelTerminationStrategy: PID 13748 died... 08:32:33.592619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13748): Terminated: ok {rc=0} 08:32:33.640187 --- ParallelTerminationStrategy: PID 13751 died... 08:32:33.660374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13751): Terminated: ok {rc=0} 08:32:33.749629 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:32:35.042825 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:32:35.049438 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:32:35.070771 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:32:35.106042 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:32:35.162072 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:32:35.184656 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:32:35.221765 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:32:35.775826 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:32:35.782480 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:35.795833 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:32:35.858796 tst switch_tch_pdch.py: using LAC 20221 08:32:36.002621 tst switch_tch_pdch.py: using RAC 76 08:32:36.136642 tst switch_tch_pdch.py: using CellId 20221 08:32:36.265971 tst switch_tch_pdch.py: using BVCI 20222 08:32:36.378309 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:36.390096 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:36.401702 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:36.413373 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:36.424729 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:36.436271 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:36.447955 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:32:36.459599 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:32:36.582700 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:32:36.702999 tst switch_tch_pdch.py:51: start network... 08:32:36.908101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:37.382711 run create_hlr_db(pid=13761): Launched 08:32:37.507964 bus /gobi_6: Setting Powered False 08:32:38.568516 run create_hlr_db(pid=13761): Terminated: ok {rc=0} 08:32:39.013594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13763): Launched 08:32:39.341342 run osmo-hlr_10.42.42.2(pid=13764): Launched 08:32:39.468089 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:40.027965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13766): Launched 08:32:40.334585 run osmo-stp_10.42.42.5(pid=13767): Launched 08:32:40.452333 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:40.979455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13769): Launched 08:32:41.097894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:41.355732 run patchelf(pid=13770): Launched 08:32:41.524644 run osmo-stp_10.42.42.5(pid=13767): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13767)] 08:32:41.653447 run osmo-stp_10.42.42.5(pid=13767): stdout: | (launched: 2022-12-09_08:32:40.278084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:41.783964 run osmo-stp_10.42.42.5(pid=13767): stderr: | [0;m[38;5;43m20221209083240448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083240448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083240448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083240449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083240449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083240449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083240449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:41.914924 run osmo-stp_10.42.42.5(pid=13767): stdout: | (launched: 2022-12-09_08:32:40.278084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:42.040054 run osmo-stp_10.42.42.5(pid=13767): stderr: | [0;m[38;5;43m20221209083240448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083240448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083240448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083240449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083240449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083240449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083240449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:42.188430 run patchelf(pid=13770): Terminating (SIGINT) 08:32:42.359855 run patchelf(pid=13770): Terminated: ok {rc=0} 08:32:42.483072 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13767): Process ended prematurely: osmo-stp_10.42.42.5(pid=13767) [trial-2357↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13767)] [trial-2357↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:32:42.491931 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 08:32:42.518614 run osmo-hlr_10.42.42.2(pid=13764): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13764)] 08:32:42.566452 run osmo-hlr_10.42.42.2(pid=13764): stdout: | (launched: 2022-12-09_08:32:39.281765) 08:32:42.616095 run osmo-hlr_10.42.42.2(pid=13764): stderr: | [0;m[1;31m20221209083239478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083239478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083239478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083239478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083239478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083239478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083239491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083239500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083239500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083239500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:42.666046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13763): Terminating (SIGTERM) 08:32:42.706197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13766): Terminating (SIGTERM) 08:32:42.746390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13769): Terminating (SIGTERM) 08:32:42.786768 --- ParallelTerminationStrategy: PID 13763 died... 08:32:42.806117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13763): Terminated: ok {rc=0} 08:32:42.850810 --- ParallelTerminationStrategy: PID 13766 died... 08:32:42.869795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13766): Terminated: ok {rc=0} 08:32:42.914109 --- ParallelTerminationStrategy: PID 13769 died... 08:32:42.932845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13769): Terminated: ok {rc=0} 08:32:43.019401 bus /gobi_0: Setting Powered False 08:32:44.119961 bus /gobi_0: Setting Powered False 08:32:45.236595 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:32:46.479122 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:32:46.485567 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:32:46.509905 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:32:46.548917 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:32:46.607693 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:32:46.650154 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:32:46.699522 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:32:47.222740 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:32:47.229870 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.242553 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:32:47.306384 tst switch_tch_pdch.py: using LAC 20222 08:32:47.435852 tst switch_tch_pdch.py: using RAC 77 08:32:47.566058 tst switch_tch_pdch.py: using CellId 20222 08:32:47.697736 tst switch_tch_pdch.py: using BVCI 20223 08:32:47.818194 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.830056 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.841793 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.853751 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.865682 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.877663 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.889850 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:32:47.901932 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:32:48.022067 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:32:48.139416 tst switch_tch_pdch.py:51: start network... 08:32:48.342752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:48.790402 run create_hlr_db(pid=13774): Launched 08:32:48.917487 bus /gobi_6: Setting Powered False 08:32:49.978704 run create_hlr_db(pid=13774): Terminated: ok {rc=0} 08:32:50.396533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13776): Launched 08:32:50.724539 run osmo-hlr_10.42.42.2(pid=13777): Launched 08:32:50.849863 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:51.386936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13779): Launched 08:32:51.717354 run osmo-stp_10.42.42.5(pid=13780): Launched 08:32:51.842601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:32:52.378803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13782): Launched 08:32:52.506094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:32:52.783057 run patchelf(pid=13783): Launched 08:32:52.966565 run osmo-stp_10.42.42.5(pid=13780): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13780)] 08:32:53.105192 run osmo-stp_10.42.42.5(pid=13780): stdout: | (launched: 2022-12-09_08:32:51.656848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:53.245212 run osmo-stp_10.42.42.5(pid=13780): stderr: | [0;m[38;5;43m20221209083251849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083251849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083251850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083251850 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083251851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083251851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083251851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:53.386087 run osmo-stp_10.42.42.5(pid=13780): stdout: | (launched: 2022-12-09_08:32:51.656848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:53.521079 run osmo-stp_10.42.42.5(pid=13780): stderr: | [0;m[38;5;43m20221209083251849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083251849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083251850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083251850 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083251851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083251851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083251851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:53.680705 run patchelf(pid=13783): Terminating (SIGINT) 08:32:53.864207 run patchelf(pid=13783): Terminated: ok {rc=0} 08:32:53.996681 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13780): Process ended prematurely: osmo-stp_10.42.42.5(pid=13780) [trial-2357↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13780)] [trial-2357↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:32:54.006688 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 08:32:54.036174 run osmo-hlr_10.42.42.2(pid=13777): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13777)] 08:32:54.087783 run osmo-hlr_10.42.42.2(pid=13777): stdout: | (launched: 2022-12-09_08:32:50.664634) 08:32:54.141194 run osmo-hlr_10.42.42.2(pid=13777): stderr: | [0;m[1;31m20221209083250862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083250862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083250862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083250862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083250862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083250862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083250875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083250883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083250883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083250883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:54.194883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13776): Terminating (SIGTERM) 08:32:54.238129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13779): Terminating (SIGTERM) 08:32:54.281135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13782): Terminating (SIGTERM) 08:32:54.324539 --- ParallelTerminationStrategy: PID 13776 died... 08:32:54.344817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13776): Terminated: ok {rc=0} 08:32:54.391982 --- ParallelTerminationStrategy: PID 13779 died... 08:32:54.411832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13779): Terminated: ok {rc=0} 08:32:54.459110 --- ParallelTerminationStrategy: PID 13782 died... 08:32:54.479245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13782): Terminated: ok {rc=0} 08:32:54.569822 bus /gobi_0: Setting Powered False 08:32:55.669811 bus /gobi_0: Setting Powered False 08:32:56.787927 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_sms:oc2g --------------------------------------------------------------------- 08:32:58.033208 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:32:58.037413 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 08:32:58.059476 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 08:32:58.067490 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 08:32:58.123384 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 08:32:58.145295 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 08:32:58.152672 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 08:32:58.690288 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:32:58.695456 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 08:32:58.706719 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 08:32:58.742606 tst mo_mt_sms.py: using LAC 20223 08:32:58.871774 tst mo_mt_sms.py: using RAC 78 08:32:58.999109 tst mo_mt_sms.py: using CellId 20223 08:32:59.126647 tst mo_mt_sms.py: using BVCI 20224 08:32:59.246865 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:32:59.373069 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:32:59.493968 tst mo_mt_sms.py:9: start nitb and bts... 08:32:59.714904 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:33:00.380111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13787): Launched 08:33:00.710397 run osmo-nitb_10.42.42.2(pid=13788): Launched 08:33:00.894008 run osmo-nitb_10.42.42.2(pid=13788): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13788)] 08:33:01.042908 run osmo-nitb_10.42.42.2(pid=13788): stdout: | (launched: 2022-12-09_08:33:00.650666) 08:33:01.211312 run osmo-nitb_10.42.42.2(pid=13788): stderr: | (launched: 2022-12-09_08:33:00.699532) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:33:01.362805 run osmo-nitb_10.42.42.2(pid=13788): stdout: | (launched: 2022-12-09_08:33:00.650666) 08:33:01.508708 run osmo-nitb_10.42.42.2(pid=13788): stderr: | (launched: 2022-12-09_08:33:00.699532) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13788): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13788) [trial-2357↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13788)] 08:33:01.835472 tst osmo-nitb_10.42.42.2(pid=13788): stdout: | (launched: 2022-12-09_08:33:00.650666) 08:33:01.969655 tst osmo-nitb_10.42.42.2(pid=13788): stderr: | (launched: 2022-12-09_08:33:00.699532) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:33:02.129549 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13788): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13788) [trial-2357↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13788)] [trial-2357↪nitb_sms:oc2g↪mo_mt_sms.py:11] 08:33:02.139521 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 08:33:02.147528 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13787): Terminating (SIGTERM) 08:33:02.363139 --- ParallelTerminationStrategy: PID 13787 died... 08:33:02.385510 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13787): Terminated: ok {rc=0} 08:33:02.474861 bus /sierra_3: Setting Powered False 08:33:03.575432 bus /sierra_3: Setting Powered False 08:33:04.694916 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:oc2g --------------------------------------------------------------------- 08:33:05.881518 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:05.885947 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 08:33:05.907932 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 08:33:05.936773 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 08:33:05.991637 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 08:33:06.013321 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 08:33:06.041664 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 08:33:06.590351 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:33:06.595546 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:33:06.606707 tst sms:oc2g: Using 1 x bts (candidates: 1) 08:33:06.646884 tst mo_mt_sms.py: using LAC 20224 08:33:06.774169 tst mo_mt_sms.py: using RAC 79 08:33:06.900014 tst mo_mt_sms.py: using CellId 20224 08:33:07.026868 tst mo_mt_sms.py: using BVCI 20225 08:33:07.145734 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:33:07.156864 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:33:07.168002 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:33:07.179731 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:33:07.191698 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:33:07.203574 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:33:07.323928 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:33:07.445118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:07.953230 run create_hlr_db(pid=13793): Launched 08:33:08.078903 bus /sierra_2: Setting Powered False 08:33:09.143268 run create_hlr_db(pid=13793): Terminated: ok {rc=0} 08:33:09.579363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13795): Launched 08:33:09.885441 run osmo-hlr_10.42.42.2(pid=13796): Launched 08:33:10.001635 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:10.526602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13798): Launched 08:33:10.831347 run osmo-stp_10.42.42.5(pid=13799): Launched 08:33:10.948120 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:11.499726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13801): Launched 08:33:11.805442 run osmo-msc_10.42.42.6(pid=13802): Launched 08:33:11.976308 run osmo-stp_10.42.42.5(pid=13799): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13799)] 08:33:12.104841 run osmo-stp_10.42.42.5(pid=13799): stdout: | (launched: 2022-12-09_08:33:10.774987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:12.233234 run osmo-stp_10.42.42.5(pid=13799): stderr: | [0;m[38;5;43m20221209083310945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083310946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083310946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083310946 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083310947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083310947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083310947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:12.360035 run osmo-stp_10.42.42.5(pid=13799): stdout: | (launched: 2022-12-09_08:33:10.774987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:12.480869 run osmo-stp_10.42.42.5(pid=13799): stderr: | [0;m[38;5;43m20221209083310945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083310946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083310946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083310946 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083310947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083310947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083310947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:12.625732 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13799): Process ended prematurely: osmo-stp_10.42.42.5(pid=13799) [trial-2357↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13799)] [trial-2357↪sms:oc2g↪mo_mt_sms.py:16] 08:33:12.634216 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 08:33:12.660285 run osmo-hlr_10.42.42.2(pid=13796): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13796)] 08:33:12.708090 run osmo-hlr_10.42.42.2(pid=13796): stdout: | (launched: 2022-12-09_08:33:09.829444) 08:33:12.757754 run osmo-hlr_10.42.42.2(pid=13796): stderr: | [0;m[1;31m20221209083310006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083310006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083310006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083310006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083310006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083310007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083310019 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083310027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:12.826923 run osmo-msc_10.42.42.6(pid=13802): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13802)] 08:33:12.874567 run osmo-msc_10.42.42.6(pid=13802): stdout: | (launched: 2022-12-09_08:33:11.749216) 08:33:12.923861 run osmo-msc_10.42.42.6(pid=13802): stderr: | [0;m[38;5;43m20221209083312022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083312022 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d4041bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083312022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083312022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083312022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083312023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083312024 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083312025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083312025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083312025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:12.973441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13795): Terminating (SIGTERM) 08:33:13.013293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13798): Terminating (SIGTERM) 08:33:13.053197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13801): Terminating (SIGTERM) 08:33:13.093883 --- ParallelTerminationStrategy: PID 13795 died... 08:33:13.113238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13795): Terminated: ok {rc=0} 08:33:13.157693 --- ParallelTerminationStrategy: PID 13798 died... 08:33:13.176494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13798): Terminated: ok {rc=0} 08:33:13.221232 --- ParallelTerminationStrategy: PID 13801 died... 08:33:13.240347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13801): Terminated: ok {rc=0} 08:33:13.327553 bus /sierra_3: Setting Powered False 08:33:14.427665 bus /sierra_3: Setting Powered False 08:33:15.544060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:oc2g --------------------------------------------------------------------- 08:33:16.800239 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:16.806521 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:33:16.837738 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 08:33:16.848053 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:33:16.893075 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:33:16.923111 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 08:33:16.933972 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:33:17.443099 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 08:33:17.448615 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 08:33:17.460071 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 08:33:17.497144 tst assert_extension.py: using LAC 20225 08:33:17.618712 tst assert_extension.py: using RAC 80 08:33:17.741044 tst assert_extension.py: using CellId 20225 08:33:17.864026 tst assert_extension.py: using BVCI 20226 08:33:17.976323 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 08:33:18.095764 tst assert_extension.py:10: start nitb and bts... 08:33:18.316769 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:33:18.982316 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13807): Launched 08:33:19.311787 run osmo-nitb_10.42.42.2(pid=13808): Launched 08:33:19.493810 run osmo-nitb_10.42.42.2(pid=13808): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13808)] 08:33:19.640683 run osmo-nitb_10.42.42.2(pid=13808): stdout: | (launched: 2022-12-09_08:33:19.252060) 08:33:19.788494 run osmo-nitb_10.42.42.2(pid=13808): stderr: | (launched: 2022-12-09_08:33:19.300897) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:33:19.936712 run osmo-nitb_10.42.42.2(pid=13808): stdout: | (launched: 2022-12-09_08:33:19.252060) 08:33:20.079246 run osmo-nitb_10.42.42.2(pid=13808): stderr: | (launched: 2022-12-09_08:33:19.300897) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13808) [trial-2357↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13808)] 08:33:20.435589 tst osmo-nitb_10.42.42.2(pid=13808): stdout: | (launched: 2022-12-09_08:33:19.252060) 08:33:20.568147 tst osmo-nitb_10.42.42.2(pid=13808): stderr: | (launched: 2022-12-09_08:33:19.300897) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:33:20.723838 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13808) [trial-2357↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13808)] [trial-2357↪nitb_ussd:oc2g↪assert_extension.py:12] 08:33:20.732840 tst assert_extension.py:12: Test FAILED (3.3 sec) 08:33:20.740000 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13807): Terminating (SIGTERM) 08:33:20.952281 --- ParallelTerminationStrategy: PID 13807 died... 08:33:20.974120 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13807): Terminated: ok {rc=0} 08:33:21.063904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:oc2g --------------------------------------------------------------------- 08:33:22.229013 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:22.232779 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:33:22.253803 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 08:33:22.281264 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:33:22.316807 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:33:22.338160 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 08:33:22.365178 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:33:22.894759 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:oc2g assert_extension.py ---------------------------------------------- 08:33:22.899866 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:33:22.910742 tst ussd:oc2g: Using 1 x bts (candidates: 1) 08:33:22.944920 tst assert_extension.py: using LAC 20226 08:33:23.064123 tst assert_extension.py: using RAC 81 08:33:23.183857 tst assert_extension.py: using CellId 20226 08:33:23.304846 tst assert_extension.py: using BVCI 20227 08:33:23.414621 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:33:23.425280 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:33:23.435803 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:33:23.446374 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:33:23.456858 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:33:23.467365 tst ussd:oc2g: Using 1 x modem (candidates: 1) 08:33:23.584020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:24.092568 run create_hlr_db(pid=13812): Launched 08:33:24.217226 bus /sierra_2: Setting Powered False 08:33:25.281967 run create_hlr_db(pid=13812): Terminated: ok {rc=0} 08:33:25.736755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13814): Launched 08:33:26.064294 run osmo-hlr_10.42.42.2(pid=13815): Launched 08:33:26.190249 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:26.763899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13817): Launched 08:33:27.091793 run osmo-stp_10.42.42.5(pid=13818): Launched 08:33:27.217049 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:27.809164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13820): Launched 08:33:28.136613 run osmo-msc_10.42.42.6(pid=13821): Launched 08:33:28.320319 run osmo-stp_10.42.42.5(pid=13818): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13818)] 08:33:28.459406 run osmo-stp_10.42.42.5(pid=13818): stdout: | (launched: 2022-12-09_08:33:27.031441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:28.599233 run osmo-stp_10.42.42.5(pid=13818): stderr: | [0;m[38;5;43m20221209083327224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083327224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083327224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083327225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083327225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083327225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083327225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:28.736028 run osmo-stp_10.42.42.5(pid=13818): stdout: | (launched: 2022-12-09_08:33:27.031441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:28.866418 run osmo-stp_10.42.42.5(pid=13818): stderr: | [0;m[38;5;43m20221209083327224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083327224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083327224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083327225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083327225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083327225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083327225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:29.022538 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13818): Process ended prematurely: osmo-stp_10.42.42.5(pid=13818) [trial-2357↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13818)] [trial-2357↪ussd:oc2g↪assert_extension.py:17] 08:33:29.031539 tst assert_extension.py:17: Test FAILED (6.1 sec) 08:33:29.059671 run osmo-hlr_10.42.42.2(pid=13815): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13815)] 08:33:29.110333 run osmo-hlr_10.42.42.2(pid=13815): stdout: | (launched: 2022-12-09_08:33:26.004263) 08:33:29.162825 run osmo-hlr_10.42.42.2(pid=13815): stderr: | [0;m[1;31m20221209083326204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083326204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083326204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083326204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083326204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083326205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083326217 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083326225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083326225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083326225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:29.235445 run osmo-msc_10.42.42.6(pid=13821): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13821)] 08:33:29.286257 run osmo-msc_10.42.42.6(pid=13821): stdout: | (launched: 2022-12-09_08:33:28.076660) 08:33:29.338777 run osmo-msc_10.42.42.6(pid=13821): stderr: | [0;m[38;5;43m20221209083328396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083328396 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd9c13dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083328396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083328396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083328397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083328397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083328398 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083328399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083328399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083328399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:29.391805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13814): Terminating (SIGTERM) 08:33:29.434035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13817): Terminating (SIGTERM) 08:33:29.476110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13820): Terminating (SIGTERM) 08:33:29.518939 --- ParallelTerminationStrategy: PID 13814 died... 08:33:29.539170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13814): Terminated: ok {rc=0} 08:33:29.586486 --- ParallelTerminationStrategy: PID 13817 died... 08:33:29.606279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13817): Terminated: ok {rc=0} 08:33:29.652765 --- ParallelTerminationStrategy: PID 13820 died... 08:33:29.672413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13820): Terminated: ok {rc=0} 08:33:29.760424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:33:30.983486 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:30.990682 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:33:31.020280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:33:31.051750 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:33:31.106285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:33:31.128177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:33:31.157276 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:33:31.709079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:33:31.761807 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:31.773669 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:33:31.829937 tst mo_mt_call.py: using LAC 20227 08:33:31.991788 tst mo_mt_call.py: using RAC 82 08:33:32.127081 tst mo_mt_call.py: using CellId 20227 08:33:32.258270 tst mo_mt_call.py: using BVCI 20228 08:33:32.380256 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:32.392307 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:32.404076 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:32.416098 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:32.428535 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:32.440662 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:33:32.567065 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:33:32.687117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:33.170850 run create_hlr_db(pid=13826): Launched 08:33:33.297831 bus /sierra_2: Setting Powered False 08:33:34.359937 run create_hlr_db(pid=13826): Terminated: ok {rc=0} 08:33:34.814892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13828): Launched 08:33:35.149399 run osmo-hlr_10.42.42.2(pid=13829): Launched 08:33:35.278595 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:35.854724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13831): Launched 08:33:36.190134 run osmo-stp_10.42.42.5(pid=13832): Launched 08:33:36.317833 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:36.921152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13834): Launched 08:33:37.254108 run osmo-msc_10.42.42.6(pid=13835): Launched 08:33:37.441726 run osmo-stp_10.42.42.5(pid=13832): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13832)] 08:33:37.582062 run osmo-stp_10.42.42.5(pid=13832): stdout: | (launched: 2022-12-09_08:33:36.128757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:37.724376 run osmo-stp_10.42.42.5(pid=13832): stderr: | [0;m[38;5;43m20221209083336321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083336321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083336322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083336322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083336322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083336322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083336323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:37.863116 run osmo-stp_10.42.42.5(pid=13832): stdout: | (launched: 2022-12-09_08:33:36.128757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:37.996236 run osmo-stp_10.42.42.5(pid=13832): stderr: | [0;m[38;5;43m20221209083336321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083336321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083336322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083336322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083336322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083336322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083336323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:38.155533 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13832): Process ended prematurely: osmo-stp_10.42.42.5(pid=13832) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13832)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:33:38.165149 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:33:38.193636 run osmo-hlr_10.42.42.2(pid=13829): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13829)] 08:33:38.244928 run osmo-hlr_10.42.42.2(pid=13829): stdout: | (launched: 2022-12-09_08:33:35.088688) 08:33:38.297676 run osmo-hlr_10.42.42.2(pid=13829): stderr: | [0;m[1;31m20221209083335287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083335287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083335287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083335287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083335288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083335288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083335300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083335309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083335309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083335309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:38.370766 run osmo-msc_10.42.42.6(pid=13835): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13835)] 08:33:38.421542 run osmo-msc_10.42.42.6(pid=13835): stdout: | (launched: 2022-12-09_08:33:37.193387) 08:33:38.474014 run osmo-msc_10.42.42.6(pid=13835): stderr: | [0;m[38;5;43m20221209083337517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083337517 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff871145c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083337517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083337517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083337518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083337518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083337519 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083337520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083337520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083337520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:38.527373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13828): Terminating (SIGTERM) 08:33:38.569822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13831): Terminating (SIGTERM) 08:33:38.612126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13834): Terminating (SIGTERM) 08:33:38.654853 --- ParallelTerminationStrategy: PID 13828 died... 08:33:38.674999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13828): Terminated: ok {rc=0} 08:33:38.722387 --- ParallelTerminationStrategy: PID 13831 died... 08:33:38.742106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13831): Terminated: ok {rc=0} 08:33:38.789049 --- ParallelTerminationStrategy: PID 13834 died... 08:33:38.808774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13834): Terminated: ok {rc=0} 08:33:38.898376 bus /sierra_3: Setting Powered False 08:33:39.998390 bus /sierra_3: Setting Powered False 08:33:41.117460 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:33:42.270793 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:42.283178 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:33:42.342695 tst mo_mt_call_osmux.py: using LAC 20228 08:33:42.469432 tst mo_mt_call_osmux.py: using RAC 83 08:33:42.594395 tst mo_mt_call_osmux.py: using CellId 20228 08:33:42.716625 tst mo_mt_call_osmux.py: using BVCI 20229 08:33:42.829388 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:42.840592 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:42.851917 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:42.862917 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:42.873893 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:33:42.884886 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:33:43.005642 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:33:43.125444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:43.608671 run create_hlr_db(pid=13837): Launched 08:33:43.735711 bus /sierra_2: Setting Powered False 08:33:44.798078 run create_hlr_db(pid=13837): Terminated: ok {rc=0} 08:33:45.252748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13839): Launched 08:33:45.585877 run osmo-hlr_10.42.42.2(pid=13840): Launched 08:33:45.715658 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:46.333765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13842): Launched 08:33:46.664534 run osmo-stp_10.42.42.5(pid=13843): Launched 08:33:46.816337 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:47.659613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13845): Launched 08:33:47.995741 run osmo-msc_10.42.42.6(pid=13846): Launched 08:33:48.184405 run osmo-stp_10.42.42.5(pid=13843): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13843)] 08:33:48.324211 run osmo-stp_10.42.42.5(pid=13843): stdout: | (launched: 2022-12-09_08:33:46.604813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:48.464759 run osmo-stp_10.42.42.5(pid=13843): stderr: | [0;m[38;5;43m20221209083347014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083347014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083347016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083347021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083347022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083347022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083347022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:48.604242 run osmo-stp_10.42.42.5(pid=13843): stdout: | (launched: 2022-12-09_08:33:46.604813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:48.737655 run osmo-stp_10.42.42.5(pid=13843): stderr: | [0;m[38;5;43m20221209083347014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083347014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083347016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083347021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083347022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083347022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083347022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:48.897141 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13843): Process ended prematurely: osmo-stp_10.42.42.5(pid=13843) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13843)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:33:48.906813 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 08:33:48.935718 run osmo-hlr_10.42.42.2(pid=13840): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13840)] 08:33:48.986849 run osmo-hlr_10.42.42.2(pid=13840): stdout: | (launched: 2022-12-09_08:33:45.525275) 08:33:49.039344 run osmo-hlr_10.42.42.2(pid=13840): stderr: | [0;m[1;31m20221209083345723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083345723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083345723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083345723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083345723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083345723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083345736 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083345746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083345746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083345746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:49.112518 run osmo-msc_10.42.42.6(pid=13846): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13846)] 08:33:49.163078 run osmo-msc_10.42.42.6(pid=13846): stdout: | (launched: 2022-12-09_08:33:47.935355) 08:33:49.215671 run osmo-msc_10.42.42.6(pid=13846): stderr: | [0;m[38;5;43m20221209083348257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083348257 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdf9ce3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083348257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083348257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083348258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083348258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083348259 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083348260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083348260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083348260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:49.268739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13839): Terminating (SIGTERM) 08:33:49.311085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13842): Terminating (SIGTERM) 08:33:49.353625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13845): Terminating (SIGTERM) 08:33:49.396210 --- ParallelTerminationStrategy: PID 13839 died... 08:33:49.416491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13839): Terminated: ok {rc=0} 08:33:49.463777 --- ParallelTerminationStrategy: PID 13842 died... 08:33:49.483730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13842): Terminated: ok {rc=0} 08:33:49.530928 --- ParallelTerminationStrategy: PID 13845 died... 08:33:49.550720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13845): Terminated: ok {rc=0} 08:33:49.639809 bus /sierra_3: Setting Powered False 08:33:50.738403 bus /sierra_3: Setting Powered False 08:33:51.854950 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:33:53.099072 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:53.106177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:33:53.128283 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:33:53.156787 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:33:53.209361 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:33:53.231379 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:33:53.259729 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:33:53.810718 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:33:53.860921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:33:53.872433 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:33:53.927907 tst mo_mt_call.py: using LAC 20229 08:33:54.048247 tst mo_mt_call.py: using RAC 84 08:33:54.169282 tst mo_mt_call.py: using CellId 20229 08:33:54.293215 tst mo_mt_call.py: using BVCI 20230 08:33:54.407982 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:33:54.419318 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:33:54.430456 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:33:54.441514 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:33:54.452570 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:33:54.463691 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:33:54.584047 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:33:54.702071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:55.188077 run create_hlr_db(pid=13851): Launched 08:33:55.315193 bus /sierra_2: Setting Powered False 08:33:56.376826 run create_hlr_db(pid=13851): Terminated: ok {rc=0} 08:33:56.834350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13853): Launched 08:33:57.169049 run osmo-hlr_10.42.42.2(pid=13854): Launched 08:33:57.297210 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:57.874397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13856): Launched 08:33:58.209783 run osmo-stp_10.42.42.5(pid=13857): Launched 08:33:58.339040 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:58.944618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13859): Launched 08:33:59.278870 run osmo-msc_10.42.42.6(pid=13860): Launched 08:33:59.467776 run osmo-stp_10.42.42.5(pid=13857): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13857)] 08:33:59.608888 run osmo-stp_10.42.42.5(pid=13857): stdout: | (launched: 2022-12-09_08:33:58.148714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:59.750032 run osmo-stp_10.42.42.5(pid=13857): stderr: | [0;m[38;5;43m20221209083358341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083358341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083358342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083358342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083358342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083358342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083358343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:59.890262 run osmo-stp_10.42.42.5(pid=13857): stdout: | (launched: 2022-12-09_08:33:58.148714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:00.023951 run osmo-stp_10.42.42.5(pid=13857): stderr: | [0;m[38;5;43m20221209083358341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083358341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083358342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083358342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083358342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083358342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083358343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:00.184116 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13857): Process ended prematurely: osmo-stp_10.42.42.5(pid=13857) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13857)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:34:00.193980 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:34:00.222973 run osmo-hlr_10.42.42.2(pid=13854): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13854)] 08:34:00.274318 run osmo-hlr_10.42.42.2(pid=13854): stdout: | (launched: 2022-12-09_08:33:57.107981) 08:34:00.327288 run osmo-hlr_10.42.42.2(pid=13854): stderr: | [0;m[1;31m20221209083357307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083357307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083357307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083357307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083357307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083357307 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083357319 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083357328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083357328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083357328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:00.400757 run osmo-msc_10.42.42.6(pid=13860): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13860)] 08:34:00.451799 run osmo-msc_10.42.42.6(pid=13860): stdout: | (launched: 2022-12-09_08:33:59.218046) 08:34:00.504407 run osmo-msc_10.42.42.6(pid=13860): stderr: | [0;m[38;5;43m20221209083359540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083359540 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc9ff57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083359540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083359540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083359540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083359541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083359542 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083359543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083359543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083359543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:00.557666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13853): Terminating (SIGTERM) 08:34:00.600302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13856): Terminating (SIGTERM) 08:34:00.642874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13859): Terminating (SIGTERM) 08:34:00.685673 --- ParallelTerminationStrategy: PID 13853 died... 08:34:00.706001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13853): Terminated: ok {rc=0} 08:34:00.753649 --- ParallelTerminationStrategy: PID 13856 died... 08:34:00.773565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13856): Terminated: ok {rc=0} 08:34:00.820502 --- ParallelTerminationStrategy: PID 13859 died... 08:34:00.840611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13859): Terminated: ok {rc=0} 08:34:00.946932 bus /sierra_3: Setting Powered False 08:34:02.071029 bus /sierra_3: Setting Powered False 08:34:03.199125 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:34:04.348159 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:34:04.360352 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:34:04.417603 tst mo_mt_call_osmux.py: using LAC 20230 08:34:04.540409 tst mo_mt_call_osmux.py: using RAC 85 08:34:04.663975 tst mo_mt_call_osmux.py: using CellId 20230 08:34:04.787514 tst mo_mt_call_osmux.py: using BVCI 20231 08:34:04.902182 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:34:04.913534 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:34:04.924584 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:34:04.935652 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:34:04.946837 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:34:04.957979 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:34:05.079360 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:34:05.200208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:05.686671 run create_hlr_db(pid=13862): Launched 08:34:05.812750 bus /sierra_2: Setting Powered False 08:34:06.875083 run create_hlr_db(pid=13862): Terminated: ok {rc=0} 08:34:07.328594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13864): Launched 08:34:07.663100 run osmo-hlr_10.42.42.2(pid=13865): Launched 08:34:07.792284 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:08.364535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13867): Launched 08:34:08.698565 run osmo-stp_10.42.42.5(pid=13868): Launched 08:34:08.827771 run osmo-msc_10.42.42.6: Starting osmo-msc 08:34:09.429843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13870): Launched 08:34:09.764618 run osmo-msc_10.42.42.6(pid=13871): Launched 08:34:09.950510 run osmo-stp_10.42.42.5(pid=13868): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13868)] 08:34:10.090491 run osmo-stp_10.42.42.5(pid=13868): stdout: | (launched: 2022-12-09_08:34:08.637958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:10.230943 run osmo-stp_10.42.42.5(pid=13868): stderr: | [0;m[38;5;43m20221209083408828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083408829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083408829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083408829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083408830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083408830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083408830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:10.370002 run osmo-stp_10.42.42.5(pid=13868): stdout: | (launched: 2022-12-09_08:34:08.637958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:10.502816 run osmo-stp_10.42.42.5(pid=13868): stderr: | [0;m[38;5;43m20221209083408828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083408829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083408829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083408829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083408830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083408830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083408830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:10.661890 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13868): Process ended prematurely: osmo-stp_10.42.42.5(pid=13868) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13868)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:34:10.671618 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:34:10.700027 run osmo-hlr_10.42.42.2(pid=13865): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13865)] 08:34:10.750480 run osmo-hlr_10.42.42.2(pid=13865): stdout: | (launched: 2022-12-09_08:34:07.602351) 08:34:10.802755 run osmo-hlr_10.42.42.2(pid=13865): stderr: | [0;m[1;31m20221209083407801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083407801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083407801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083407801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083407801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083407801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083407812 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083407822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083407822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083407822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:10.875766 run osmo-msc_10.42.42.6(pid=13871): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13871)] 08:34:10.926117 run osmo-msc_10.42.42.6(pid=13871): stdout: | (launched: 2022-12-09_08:34:09.703876) 08:34:10.978680 run osmo-msc_10.42.42.6(pid=13871): stderr: | [0;m[38;5;43m20221209083410028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083410028 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f34b5074c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083410028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083410028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083410028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083410029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083410030 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083410031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083410031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083410031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:11.031398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13864): Terminating (SIGTERM) 08:34:11.073565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13867): Terminating (SIGTERM) 08:34:11.115725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13870): Terminating (SIGTERM) 08:34:11.158134 --- ParallelTerminationStrategy: PID 13864 died... 08:34:11.178301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13864): Terminated: ok {rc=0} 08:34:11.225257 --- ParallelTerminationStrategy: PID 13867 died... 08:34:11.244875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13867): Terminated: ok {rc=0} 08:34:11.291704 --- ParallelTerminationStrategy: PID 13870 died... 08:34:11.311392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13870): Terminated: ok {rc=0} 08:34:11.399011 bus /sierra_3: Setting Powered False 08:34:12.498578 bus /sierra_3: Setting Powered False 08:34:13.616563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:34:14.857099 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:34:14.864069 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:34:14.886760 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:34:14.915897 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:34:14.971480 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:34:14.993278 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:34:15.021114 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:34:15.574213 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:34:15.629189 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:15.641032 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:34:15.700248 tst mo_mt_call.py: using LAC 20231 08:34:15.833084 tst mo_mt_call.py: using RAC 86 08:34:15.987193 tst mo_mt_call.py: using CellId 20231 08:34:16.129305 tst mo_mt_call.py: using BVCI 20232 08:34:16.247945 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:16.260208 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:16.271918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:16.283654 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:16.296134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:16.308010 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:34:16.431481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:34:16.559732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:17.056828 run create_hlr_db(pid=13876): Launched 08:34:17.216744 bus /sierra_2: Setting Powered False 08:34:18.278831 run create_hlr_db(pid=13876): Terminated: ok {rc=0} 08:34:18.731625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13878): Launched 08:34:19.066243 run osmo-hlr_10.42.42.2(pid=13879): Launched 08:34:19.195279 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:19.771268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13881): Launched 08:34:20.105434 run osmo-stp_10.42.42.5(pid=13882): Launched 08:34:20.232435 run osmo-msc_10.42.42.6: Starting osmo-msc 08:34:20.834419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13884): Launched 08:34:21.167622 run osmo-msc_10.42.42.6(pid=13885): Launched 08:34:21.355949 run osmo-stp_10.42.42.5(pid=13882): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13882)] 08:34:21.496369 run osmo-stp_10.42.42.5(pid=13882): stdout: | (launched: 2022-12-09_08:34:20.044514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:21.638048 run osmo-stp_10.42.42.5(pid=13882): stderr: | [0;m[38;5;43m20221209083420239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083420239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083420239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083420240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083420240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083420240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083420240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:21.776876 run osmo-stp_10.42.42.5(pid=13882): stdout: | (launched: 2022-12-09_08:34:20.044514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:21.910496 run osmo-stp_10.42.42.5(pid=13882): stderr: | [0;m[38;5;43m20221209083420239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083420239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083420239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083420240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083420240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083420240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083420240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:22.070013 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13882): Process ended prematurely: osmo-stp_10.42.42.5(pid=13882) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13882)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:34:22.079634 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:34:22.108475 run osmo-hlr_10.42.42.2(pid=13879): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13879)] 08:34:22.159490 run osmo-hlr_10.42.42.2(pid=13879): stdout: | (launched: 2022-12-09_08:34:19.005655) 08:34:22.211710 run osmo-hlr_10.42.42.2(pid=13879): stderr: | [0;m[1;31m20221209083419204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083419204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083419204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083419204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083419204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083419204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083419216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083419227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083419227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083419227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:22.284626 run osmo-msc_10.42.42.6(pid=13885): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13885)] 08:34:22.335482 run osmo-msc_10.42.42.6(pid=13885): stdout: | (launched: 2022-12-09_08:34:21.107018) 08:34:22.387679 run osmo-msc_10.42.42.6(pid=13885): stderr: | [0;m[38;5;43m20221209083421430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083421430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbef54b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083421430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083421430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083421430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083421430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083421432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083421433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083421433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083421433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:22.440594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13878): Terminating (SIGTERM) 08:34:22.482767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13881): Terminating (SIGTERM) 08:34:22.525310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13884): Terminating (SIGTERM) 08:34:22.567929 --- ParallelTerminationStrategy: PID 13878 died... 08:34:22.588072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13878): Terminated: ok {rc=0} 08:34:22.635288 --- ParallelTerminationStrategy: PID 13881 died... 08:34:22.655098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13881): Terminated: ok {rc=0} 08:34:22.701900 --- ParallelTerminationStrategy: PID 13884 died... 08:34:22.721530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13884): Terminated: ok {rc=0} 08:34:22.810255 bus /sierra_3: Setting Powered False 08:34:23.908436 bus /sierra_3: Setting Powered False 08:34:25.027395 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:34:26.175220 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:26.187306 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:34:26.244534 tst mo_mt_call_osmux.py: using LAC 20232 08:34:26.369093 tst mo_mt_call_osmux.py: using RAC 87 08:34:26.493044 tst mo_mt_call_osmux.py: using CellId 20232 08:34:26.614818 tst mo_mt_call_osmux.py: using BVCI 20233 08:34:26.729418 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:26.740586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:26.751619 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:26.762650 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:26.773625 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:34:26.784606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:34:26.901884 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:34:27.023963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:27.543973 run create_hlr_db(pid=13887): Launched 08:34:27.672322 bus /sierra_2: Setting Powered False 08:34:28.738679 run create_hlr_db(pid=13887): Terminated: ok {rc=0} 08:34:29.200061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Launched 08:34:29.533519 run osmo-hlr_10.42.42.2(pid=13890): Launched 08:34:29.664180 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:30.239281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Launched 08:34:30.573609 run osmo-stp_10.42.42.5(pid=13893): Launched 08:34:30.703739 run osmo-msc_10.42.42.6: Starting osmo-msc 08:34:31.313310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Launched 08:34:31.649475 run osmo-msc_10.42.42.6(pid=13896): Launched 08:34:32.226530 run osmo-stp_10.42.42.5(pid=13893): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] 08:34:32.423129 run osmo-stp_10.42.42.5(pid=13893): stdout: | (launched: 2022-12-09_08:34:30.512382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:32.553810 run osmo-stp_10.42.42.5(pid=13893): stderr: | [0;m[38;5;43m20221209083430707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083430707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083430707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083430708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083430708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083430708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083430709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:32.683962 run osmo-stp_10.42.42.5(pid=13893): stdout: | (launched: 2022-12-09_08:34:30.512382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:32.808550 run osmo-stp_10.42.42.5(pid=13893): stderr: | [0;m[38;5;43m20221209083430707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083430707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083430707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083430708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083430708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083430708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083430709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:32.958022 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13893): Process ended prematurely: osmo-stp_10.42.42.5(pid=13893) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:34:32.966921 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 08:34:32.994278 run osmo-hlr_10.42.42.2(pid=13890): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13890)] 08:34:33.043589 run osmo-hlr_10.42.42.2(pid=13890): stdout: | (launched: 2022-12-09_08:34:29.472401) 08:34:33.093839 run osmo-hlr_10.42.42.2(pid=13890): stderr: | [0;m[1;31m20221209083429671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083429671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083429671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083429671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083429671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083429671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083429683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083429694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083429695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083429695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:33.163857 run osmo-msc_10.42.42.6(pid=13896): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13896)] 08:34:33.212503 run osmo-msc_10.42.42.6(pid=13896): stdout: | (launched: 2022-12-09_08:34:31.589111) 08:34:33.262753 run osmo-msc_10.42.42.6(pid=13896): stderr: | [0;m[38;5;43m20221209083432052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083432053 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2722238c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083432053 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083432053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083432054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083432055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083432060 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083432062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083432062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083432063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:33.313521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Terminating (SIGTERM) 08:34:33.354073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Terminating (SIGTERM) 08:34:33.394631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Terminating (SIGTERM) 08:34:33.435515 --- ParallelTerminationStrategy: PID 13889 died... 08:34:33.454902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Terminated: ok {rc=0} 08:34:33.500052 --- ParallelTerminationStrategy: PID 13892 died... 08:34:33.519014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Terminated: ok {rc=0} 08:34:33.564227 --- ParallelTerminationStrategy: PID 13895 died... 08:34:33.583329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Terminated: ok {rc=0} 08:34:33.669298 bus /sierra_3: Setting Powered False 08:34:34.768420 bus /sierra_3: Setting Powered False 08:34:35.884428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:34:37.120448 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:34:37.126920 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:34:37.147974 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:34:37.174874 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:34:37.227438 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:34:37.248290 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:34:37.275156 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:34:37.827448 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:34:37.876842 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:37.888130 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:34:37.944861 tst mo_mt_call.py: using LAC 20233 08:34:38.067872 tst mo_mt_call.py: using RAC 88 08:34:38.190423 tst mo_mt_call.py: using CellId 20233 08:34:38.314032 tst mo_mt_call.py: using BVCI 20234 08:34:38.426585 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:38.438025 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:38.449024 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:38.459977 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:38.471010 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:38.482142 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:34:38.602899 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:34:38.724278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:39.208871 run create_hlr_db(pid=13901): Launched 08:34:39.336653 bus /sierra_2: Setting Powered False 08:34:40.398515 run create_hlr_db(pid=13901): Terminated: ok {rc=0} 08:34:40.853301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13903): Launched 08:34:41.187286 run osmo-hlr_10.42.42.2(pid=13904): Launched 08:34:41.316712 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:41.893865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13906): Launched 08:34:42.227797 run osmo-stp_10.42.42.5(pid=13908): Launched 08:34:42.355558 run osmo-msc_10.42.42.6: Starting osmo-msc 08:34:42.958912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13910): Launched 08:34:43.292028 run osmo-msc_10.42.42.6(pid=13911): Launched 08:34:43.480350 run osmo-stp_10.42.42.5(pid=13908): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13908)] 08:34:43.621501 run osmo-stp_10.42.42.5(pid=13908): stdout: | (launched: 2022-12-09_08:34:42.167008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:43.762718 run osmo-stp_10.42.42.5(pid=13908): stderr: | [0;m[38;5;43m20221209083442359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083442359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083442359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083442360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083442360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083442360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083442360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:43.902120 run osmo-stp_10.42.42.5(pid=13908): stdout: | (launched: 2022-12-09_08:34:42.167008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:44.035342 run osmo-stp_10.42.42.5(pid=13908): stderr: | [0;m[38;5;43m20221209083442359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083442359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083442359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083442360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083442360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083442360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083442360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:44.195262 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13908): Process ended prematurely: osmo-stp_10.42.42.5(pid=13908) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13908)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:34:44.204884 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:34:44.233777 run osmo-hlr_10.42.42.2(pid=13904): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13904)] 08:34:44.284927 run osmo-hlr_10.42.42.2(pid=13904): stdout: | (launched: 2022-12-09_08:34:41.126373) 08:34:44.337893 run osmo-hlr_10.42.42.2(pid=13904): stderr: | [0;m[1;31m20221209083441324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083441324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083441324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083441324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083441324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083441324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083441337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083441346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083441346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083441346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:44.411259 run osmo-msc_10.42.42.6(pid=13911): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13911)] 08:34:44.462493 run osmo-msc_10.42.42.6(pid=13911): stdout: | (launched: 2022-12-09_08:34:43.231526) 08:34:44.515232 run osmo-msc_10.42.42.6(pid=13911): stderr: | [0;m[38;5;43m20221209083443552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083443552 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2057f1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083443552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083443552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083443553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083443553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083443555 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083443555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083443555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083443555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:44.568921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13903): Terminating (SIGTERM) 08:34:44.612007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13906): Terminating (SIGTERM) 08:34:44.654663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13910): Terminating (SIGTERM) 08:34:44.697561 --- ParallelTerminationStrategy: PID 13903 died... 08:34:44.717820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13903): Terminated: ok {rc=0} 08:34:44.765168 --- ParallelTerminationStrategy: PID 13906 died... 08:34:44.785095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13906): Terminated: ok {rc=0} 08:34:44.832020 --- ParallelTerminationStrategy: PID 13910 died... 08:34:44.851833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13910): Terminated: ok {rc=0} 08:34:44.940756 bus /sierra_3: Setting Powered False 08:34:46.042707 bus /sierra_3: Setting Powered False 08:34:47.174896 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:34:48.331936 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:48.344442 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:34:48.401940 tst mo_mt_call_osmux.py: using LAC 20234 08:34:48.533230 tst mo_mt_call_osmux.py: using RAC 89 08:34:48.654955 tst mo_mt_call_osmux.py: using CellId 20234 08:34:48.775303 tst mo_mt_call_osmux.py: using BVCI 20235 08:34:48.889501 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:48.900608 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:48.911745 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:48.923013 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:48.934086 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:34:48.945114 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:34:49.067287 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:34:49.192471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:49.711560 run create_hlr_db(pid=13913): Launched 08:34:49.838413 bus /sierra_2: Setting Powered False 08:34:50.903089 run create_hlr_db(pid=13913): Terminated: ok {rc=0} 08:34:51.364441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13915): Launched 08:34:51.698624 run osmo-hlr_10.42.42.2(pid=13916): Launched 08:34:51.827752 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:52.399697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13918): Launched 08:34:52.734915 run osmo-stp_10.42.42.5(pid=13919): Launched 08:34:52.863881 run osmo-msc_10.42.42.6: Starting osmo-msc 08:34:53.464840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13921): Launched 08:34:53.797518 run osmo-msc_10.42.42.6(pid=13922): Launched 08:34:53.984490 run osmo-stp_10.42.42.5(pid=13919): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13919)] 08:34:54.123958 run osmo-stp_10.42.42.5(pid=13919): stdout: | (launched: 2022-12-09_08:34:52.674328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:54.263852 run osmo-stp_10.42.42.5(pid=13919): stderr: | [0;m[38;5;43m20221209083452868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083452868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083452868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083452869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083452869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083452869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083452869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:54.402190 run osmo-stp_10.42.42.5(pid=13919): stdout: | (launched: 2022-12-09_08:34:52.674328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:54.534826 run osmo-stp_10.42.42.5(pid=13919): stderr: | [0;m[38;5;43m20221209083452868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083452868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083452868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083452869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083452869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083452869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083452869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:54.693643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13919): Process ended prematurely: osmo-stp_10.42.42.5(pid=13919) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13919)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:34:54.703412 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:34:54.732026 run osmo-hlr_10.42.42.2(pid=13916): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13916)] 08:34:54.782737 run osmo-hlr_10.42.42.2(pid=13916): stdout: | (launched: 2022-12-09_08:34:51.637907) 08:34:54.834846 run osmo-hlr_10.42.42.2(pid=13916): stderr: | [0;m[1;31m20221209083451835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083451835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083451835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083451835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083451835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083451835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083451868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083451878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083451878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083451878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:54.907668 run osmo-msc_10.42.42.6(pid=13922): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13922)] 08:34:54.958275 run osmo-msc_10.42.42.6(pid=13922): stdout: | (launched: 2022-12-09_08:34:53.736707) 08:34:55.010581 run osmo-msc_10.42.42.6(pid=13922): stderr: | [0;m[38;5;43m20221209083454058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083454058 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f727f1c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083454058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083454058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083454058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083454058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083454060 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083454061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083454061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083454061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:55.063256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13915): Terminating (SIGTERM) 08:34:55.105590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13918): Terminating (SIGTERM) 08:34:55.147880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13921): Terminating (SIGTERM) 08:34:55.190528 --- ParallelTerminationStrategy: PID 13915 died... 08:34:55.210638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13915): Terminated: ok {rc=0} 08:34:55.257739 --- ParallelTerminationStrategy: PID 13918 died... 08:34:55.277520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13918): Terminated: ok {rc=0} 08:34:55.324362 --- ParallelTerminationStrategy: PID 13921 died... 08:34:55.344046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13921): Terminated: ok {rc=0} 08:34:55.432603 bus /sierra_3: Setting Powered False 08:34:56.531691 bus /sierra_3: Setting Powered False 08:34:57.643784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:34:58.885653 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:34:58.892586 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:34:58.915188 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:34:58.943412 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:34:58.997220 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:34:59.018731 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:34:59.047057 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:34:59.600868 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:34:59.654355 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:34:59.666143 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:34:59.725448 tst mo_mt_call.py: using LAC 20235 08:34:59.856474 tst mo_mt_call.py: using RAC 90 08:34:59.986514 tst mo_mt_call.py: using CellId 20235 08:35:00.119373 tst mo_mt_call.py: using BVCI 20236 08:35:00.241612 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:00.253370 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:00.264867 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:00.276664 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:00.288493 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:00.300226 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:35:00.422477 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:35:00.541978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:01.072673 run create_hlr_db(pid=13927): Launched 08:35:01.243093 bus /sierra_2: Setting Powered False 08:35:02.310650 run create_hlr_db(pid=13927): Terminated: ok {rc=0} 08:35:02.768424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13939): Launched 08:35:03.101666 run osmo-hlr_10.42.42.2(pid=13940): Launched 08:35:03.229556 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:03.808839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13942): Launched 08:35:04.143273 run osmo-stp_10.42.42.5(pid=13943): Launched 08:35:04.272839 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:04.877180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13945): Launched 08:35:05.210657 run osmo-msc_10.42.42.6(pid=13946): Launched 08:35:05.398929 run osmo-stp_10.42.42.5(pid=13943): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13943)] 08:35:05.539577 run osmo-stp_10.42.42.5(pid=13943): stdout: | (launched: 2022-12-09_08:35:04.082266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:05.681367 run osmo-stp_10.42.42.5(pid=13943): stderr: | [0;m[38;5;43m20221209083504274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083504274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083504275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083504275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083504275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083504276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083504276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:05.820858 run osmo-stp_10.42.42.5(pid=13943): stdout: | (launched: 2022-12-09_08:35:04.082266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:05.954614 run osmo-stp_10.42.42.5(pid=13943): stderr: | [0;m[38;5;43m20221209083504274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083504274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083504275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083504275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083504275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083504276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083504276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:06.114567 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13943): Process ended prematurely: osmo-stp_10.42.42.5(pid=13943) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13943)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:35:06.124192 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:35:06.152881 run osmo-hlr_10.42.42.2(pid=13940): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13940)] 08:35:06.203592 run osmo-hlr_10.42.42.2(pid=13940): stdout: | (launched: 2022-12-09_08:35:03.040772) 08:35:06.255872 run osmo-hlr_10.42.42.2(pid=13940): stderr: | [0;m[1;31m20221209083503241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083503241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083503241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083503241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083503241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083503241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083503255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083503265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083503265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083503265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:06.328858 run osmo-msc_10.42.42.6(pid=13946): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13946)] 08:35:06.379897 run osmo-msc_10.42.42.6(pid=13946): stdout: | (launched: 2022-12-09_08:35:05.149865) 08:35:06.432277 run osmo-msc_10.42.42.6(pid=13946): stderr: | [0;m[38;5;43m20221209083505472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083505472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d9b350c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083505472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083505472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083505472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083505473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083505474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083505475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083505475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083505475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:06.485168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13939): Terminating (SIGTERM) 08:35:06.527508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13942): Terminating (SIGTERM) 08:35:06.570233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13945): Terminating (SIGTERM) 08:35:06.613458 --- ParallelTerminationStrategy: PID 13939 died... 08:35:06.633706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13939): Terminated: ok {rc=0} 08:35:06.680561 --- ParallelTerminationStrategy: PID 13942 died... 08:35:06.700244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13942): Terminated: ok {rc=0} 08:35:06.747274 --- ParallelTerminationStrategy: PID 13945 died... 08:35:06.766964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13945): Terminated: ok {rc=0} 08:35:06.855703 bus /sierra_3: Setting Powered False 08:35:07.954450 bus /sierra_3: Setting Powered False 08:35:09.073937 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:35:10.222178 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:10.234151 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:35:10.291333 tst mo_mt_call_osmux.py: using LAC 20236 08:35:10.416047 tst mo_mt_call_osmux.py: using RAC 91 08:35:10.551732 tst mo_mt_call_osmux.py: using CellId 20236 08:35:10.682994 tst mo_mt_call_osmux.py: using BVCI 20237 08:35:10.804133 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:10.815979 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:10.827719 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:10.839684 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:10.851611 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:35:10.863576 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:35:10.987981 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:35:11.108817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:11.593159 run create_hlr_db(pid=13948): Launched 08:35:11.719785 bus /sierra_2: Setting Powered False 08:35:12.787180 run create_hlr_db(pid=13948): Terminated: ok {rc=0} 08:35:13.262472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14144): Launched 08:35:13.618733 run osmo-hlr_10.42.42.2(pid=14221): Launched 08:35:13.788592 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:14.455319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14304): Launched 08:35:14.791619 run osmo-stp_10.42.42.5(pid=14305): Launched 08:35:14.919923 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:15.525694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14307): Launched 08:35:15.844063 run osmo-msc_10.42.42.6(pid=14308): Launched 08:35:16.108636 run osmo-stp_10.42.42.5(pid=14305): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14305)] 08:35:16.342416 run osmo-stp_10.42.42.5(pid=14305): stdout: | (launched: 2022-12-09_08:35:14.730854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:16.667436 run osmo-stp_10.42.42.5(pid=14305): stderr: | [0;m[38;5;43m20221209083514921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083514921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083514921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083514922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083514922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083514922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083514922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:16.854776 run osmo-stp_10.42.42.5(pid=14305): stdout: | (launched: 2022-12-09_08:35:14.730854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:16.983514 run osmo-stp_10.42.42.5(pid=14305): stderr: | [0;m[38;5;43m20221209083514921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083514921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083514921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083514922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083514922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083514922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083514922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:17.136918 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14305): Process ended prematurely: osmo-stp_10.42.42.5(pid=14305) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14305)] [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:35:17.146987 tst mo_mt_call_osmux.py:8: Test FAILED (7.0 sec) 08:35:17.175478 run osmo-hlr_10.42.42.2(pid=14221): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14221)] 08:35:17.226176 run osmo-hlr_10.42.42.2(pid=14221): stdout: | (launched: 2022-12-09_08:35:13.554235) 08:35:17.277935 run osmo-hlr_10.42.42.2(pid=14221): stderr: | [0;m[1;31m20221209083513848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083513848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083513848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083513849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083513849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083513849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083513864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083513894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083513894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083513894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:17.349545 run osmo-msc_10.42.42.6(pid=14308): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14308)] 08:35:17.400057 run osmo-msc_10.42.42.6(pid=14308): stdout: | (launched: 2022-12-09_08:35:15.780872) 08:35:17.450027 run osmo-msc_10.42.42.6(pid=14308): stderr: | [0;m[38;5;43m20221209083516470 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083516470 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5aa854c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083516471 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083516471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083516471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083516471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083516473 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083516474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083516474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083516474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:17.500384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14144): Terminating (SIGTERM) 08:35:17.540655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14304): Terminating (SIGTERM) 08:35:17.580675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14307): Terminating (SIGTERM) 08:35:17.622224 --- ParallelTerminationStrategy: PID 14144 died... 08:35:17.641562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14144): Terminated: ok {rc=0} 08:35:17.686483 --- ParallelTerminationStrategy: PID 14304 died... 08:35:17.705498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14304): Terminated: ok {rc=0} 08:35:17.750641 --- ParallelTerminationStrategy: PID 14307 died... 08:35:17.769645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14307): Terminated: ok {rc=0} 08:35:17.856131 bus /sierra_3: Setting Powered False 08:35:18.957159 bus /sierra_3: Setting Powered False 08:35:20.073235 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:35:21.320508 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:21.328054 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:35:21.349694 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:35:21.376256 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:35:21.427111 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:35:21.447844 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:35:21.474565 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:35:22.032163 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:35:22.088129 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:22.100134 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:35:22.158398 tst mo_mt_call.py: using LAC 20237 08:35:22.290688 tst mo_mt_call.py: using RAC 92 08:35:22.412230 tst mo_mt_call.py: using CellId 20237 08:35:22.545396 tst mo_mt_call.py: using BVCI 20238 08:35:22.677232 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:22.690106 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:22.703151 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:22.718317 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:22.732106 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:22.745038 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:35:22.874856 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:35:23.005314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:23.544362 run create_hlr_db(pid=14489): Launched 08:35:23.699727 bus /sierra_2: Setting Powered False 08:35:24.763019 run create_hlr_db(pid=14489): Terminated: ok {rc=0} 08:35:25.206514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14491): Launched 08:35:25.536527 run osmo-hlr_10.42.42.2(pid=14492): Launched 08:35:25.784537 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:26.495573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14494): Launched 08:35:26.829890 run osmo-stp_10.42.42.5(pid=14495): Launched 08:35:27.081224 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:27.793928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14497): Launched 08:35:28.133627 run osmo-msc_10.42.42.6(pid=14499): Launched 08:35:28.364007 run osmo-stp_10.42.42.5(pid=14495): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14495)] 08:35:28.505210 run osmo-stp_10.42.42.5(pid=14495): stdout: | (launched: 2022-12-09_08:35:26.771082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:28.647722 run osmo-stp_10.42.42.5(pid=14495): stderr: | [0;m[38;5;43m20221209083527095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083527095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083527096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083527096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083527097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083527097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083527097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:28.787613 run osmo-stp_10.42.42.5(pid=14495): stdout: | (launched: 2022-12-09_08:35:26.771082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:28.921567 run osmo-stp_10.42.42.5(pid=14495): stderr: | [0;m[38;5;43m20221209083527095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083527095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083527096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083527096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083527097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083527097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083527097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:29.081648 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14495): Process ended prematurely: osmo-stp_10.42.42.5(pid=14495) [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14495)] [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:35:29.091492 tst mo_mt_call.py:8: Test FAILED (7.0 sec) 08:35:29.120541 run osmo-hlr_10.42.42.2(pid=14492): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14492)] 08:35:29.171935 run osmo-hlr_10.42.42.2(pid=14492): stdout: | (launched: 2022-12-09_08:35:25.478548) 08:35:29.225221 run osmo-hlr_10.42.42.2(pid=14492): stderr: | [0;m[1;31m20221209083525814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083525814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083525814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083525814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083525814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083525814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083525834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083525843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083525843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083525843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:29.299164 run osmo-msc_10.42.42.6(pid=14499): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14499)] 08:35:29.350586 run osmo-msc_10.42.42.6(pid=14499): stdout: | (launched: 2022-12-09_08:35:28.071270) 08:35:29.403695 run osmo-msc_10.42.42.6(pid=14499): stderr: | [0;m[38;5;43m20221209083528419 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083528420 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f35ddd76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083528420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083528420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083528420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083528420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083528422 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083528422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083528422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083528422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:29.457433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14491): Terminating (SIGTERM) 08:35:29.500486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14494): Terminating (SIGTERM) 08:35:29.543441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14497): Terminating (SIGTERM) 08:35:29.587016 --- ParallelTerminationStrategy: PID 14491 died... 08:35:29.607646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14491): Terminated: ok {rc=0} 08:35:29.655593 --- ParallelTerminationStrategy: PID 14494 died... 08:35:29.675777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14494): Terminated: ok {rc=0} 08:35:29.723572 --- ParallelTerminationStrategy: PID 14497 died... 08:35:29.743589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14497): Terminated: ok {rc=0} 08:35:29.833759 bus /sierra_3: Setting Powered False 08:35:30.948149 bus /sierra_3: Setting Powered False 08:35:32.078873 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:35:33.245992 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:33.258814 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:35:33.318886 tst mo_mt_call_osmux.py: using LAC 20238 08:35:33.455023 tst mo_mt_call_osmux.py: using RAC 93 08:35:33.586418 tst mo_mt_call_osmux.py: using CellId 20238 08:35:33.715795 tst mo_mt_call_osmux.py: using BVCI 20239 08:35:33.839530 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:33.851603 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:33.863204 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:33.874784 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:33.887247 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:35:33.899439 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:35:34.022509 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:35:34.142064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:34.629118 run create_hlr_db(pid=14501): Launched 08:35:34.755938 bus /sierra_2: Setting Powered False 08:35:35.817802 run create_hlr_db(pid=14501): Terminated: ok {rc=0} 08:35:36.272767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14503): Launched 08:35:36.608833 run osmo-hlr_10.42.42.2(pid=14504): Launched 08:35:36.737510 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:37.313662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14506): Launched 08:35:37.649064 run osmo-stp_10.42.42.5(pid=14507): Launched 08:35:37.778595 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:38.382323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14509): Launched 08:35:38.717987 run osmo-msc_10.42.42.6(pid=14510): Launched 08:35:38.904243 run osmo-stp_10.42.42.5(pid=14507): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14507)] 08:35:39.044732 run osmo-stp_10.42.42.5(pid=14507): stdout: | (launched: 2022-12-09_08:35:37.587891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:39.185626 run osmo-stp_10.42.42.5(pid=14507): stderr: | [0;m[38;5;43m20221209083537780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083537780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083537780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083537781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083537781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083537781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083537781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:39.325299 run osmo-stp_10.42.42.5(pid=14507): stdout: | (launched: 2022-12-09_08:35:37.587891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:39.458962 run osmo-stp_10.42.42.5(pid=14507): stderr: | [0;m[38;5;43m20221209083537780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083537780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083537780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083537781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083537781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083537781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083537781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:39.619685 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14507): Process ended prematurely: osmo-stp_10.42.42.5(pid=14507) [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14507)] [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:35:39.629583 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:35:39.658104 run osmo-hlr_10.42.42.2(pid=14504): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14504)] 08:35:39.709443 run osmo-hlr_10.42.42.2(pid=14504): stdout: | (launched: 2022-12-09_08:35:36.547206) 08:35:39.762217 run osmo-hlr_10.42.42.2(pid=14504): stderr: | [0;m[1;31m20221209083536748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083536748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083536748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083536748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083536748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083536748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083536760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083536768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083536769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083536769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:39.835480 run osmo-msc_10.42.42.6(pid=14510): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14510)] 08:35:39.886195 run osmo-msc_10.42.42.6(pid=14510): stdout: | (launched: 2022-12-09_08:35:38.656663) 08:35:39.938897 run osmo-msc_10.42.42.6(pid=14510): stderr: | [0;m[38;5;43m20221209083538980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083538980 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f53cfd54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083538980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083538980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083538980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083538980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083538982 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083538982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083538983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083538983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:39.991710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14503): Terminating (SIGTERM) 08:35:40.034306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14506): Terminating (SIGTERM) 08:35:40.076838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14509): Terminating (SIGTERM) 08:35:40.119671 --- ParallelTerminationStrategy: PID 14503 died... 08:35:40.139966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14503): Terminated: ok {rc=0} 08:35:40.187366 --- ParallelTerminationStrategy: PID 14506 died... 08:35:40.207196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14506): Terminated: ok {rc=0} 08:35:40.254174 --- ParallelTerminationStrategy: PID 14509 died... 08:35:40.273963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14509): Terminated: ok {rc=0} 08:35:40.362579 bus /sierra_3: Setting Powered False 08:35:41.461348 bus /sierra_3: Setting Powered False 08:35:42.577727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:35:43.821373 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:43.827527 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:35:43.850150 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:35:43.879447 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:35:43.933912 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:35:43.955817 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:35:43.984650 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:35:44.535951 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:35:44.587479 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:44.598709 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:35:44.655892 tst mo_mt_call.py: using LAC 20239 08:35:44.780407 tst mo_mt_call.py: using RAC 94 08:35:44.905012 tst mo_mt_call.py: using CellId 20239 08:35:45.028805 tst mo_mt_call.py: using BVCI 20240 08:35:45.143637 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:45.154785 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:45.165617 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:45.176392 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:45.187212 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:45.198012 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:35:45.319835 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:35:45.440302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:45.961694 run create_hlr_db(pid=14515): Launched 08:35:46.134034 bus /sierra_2: Setting Powered False 08:35:47.217718 run create_hlr_db(pid=14515): Terminated: ok {rc=0} 08:35:47.689933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14517): Launched 08:35:48.025284 run osmo-hlr_10.42.42.2(pid=14518): Launched 08:35:48.153169 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:48.726248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14520): Launched 08:35:49.061365 run osmo-stp_10.42.42.5(pid=14521): Launched 08:35:49.189410 run osmo-msc_10.42.42.6: Starting osmo-msc 08:35:49.793393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14523): Launched 08:35:50.127162 run osmo-msc_10.42.42.6(pid=14524): Launched 08:35:50.315744 run osmo-stp_10.42.42.5(pid=14521): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14521)] 08:35:50.456604 run osmo-stp_10.42.42.5(pid=14521): stdout: | (launched: 2022-12-09_08:35:49.000394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:50.598457 run osmo-stp_10.42.42.5(pid=14521): stderr: | [0;m[38;5;43m20221209083549193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083549193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083549194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083549194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083549195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083549195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083549195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:50.739305 run osmo-stp_10.42.42.5(pid=14521): stdout: | (launched: 2022-12-09_08:35:49.000394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:50.873199 run osmo-stp_10.42.42.5(pid=14521): stderr: | [0;m[38;5;43m20221209083549193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083549193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083549194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083549194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083549195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083549195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083549195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:51.033222 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14521): Process ended prematurely: osmo-stp_10.42.42.5(pid=14521) [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14521)] [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:35:51.042916 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:35:51.071970 run osmo-hlr_10.42.42.2(pid=14518): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14518)] 08:35:51.123453 run osmo-hlr_10.42.42.2(pid=14518): stdout: | (launched: 2022-12-09_08:35:47.964130) 08:35:51.176023 run osmo-hlr_10.42.42.2(pid=14518): stderr: | [0;m[1;31m20221209083548162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083548162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083548163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083548163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083548163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083548163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083548175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083548184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083548184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083548184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:51.250098 run osmo-msc_10.42.42.6(pid=14524): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14524)] 08:35:51.301457 run osmo-msc_10.42.42.6(pid=14524): stdout: | (launched: 2022-12-09_08:35:50.066309) 08:35:51.354255 run osmo-msc_10.42.42.6(pid=14524): stderr: | [0;m[38;5;43m20221209083550389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083550390 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f064bb68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083550390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083550390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083550390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083550391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083550392 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083550393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083550393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083550393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:35:51.407245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14517): Terminating (SIGTERM) 08:35:51.450088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14520): Terminating (SIGTERM) 08:35:51.493057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14523): Terminating (SIGTERM) 08:35:51.536416 --- ParallelTerminationStrategy: PID 14517 died... 08:35:51.556896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14517): Terminated: ok {rc=0} 08:35:51.604877 --- ParallelTerminationStrategy: PID 14520 died... 08:35:51.625267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14520): Terminated: ok {rc=0} 08:35:51.672592 --- ParallelTerminationStrategy: PID 14523 died... 08:35:51.692604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14523): Terminated: ok {rc=0} 08:35:51.781712 bus /sierra_3: Setting Powered False 08:35:52.882174 bus /sierra_3: Setting Powered False 08:35:54.000071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:35:55.150538 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:55.162462 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:35:55.221451 tst mo_mt_call_osmux.py: using LAC 20240 08:35:55.345119 tst mo_mt_call_osmux.py: using RAC 95 08:35:55.466850 tst mo_mt_call_osmux.py: using CellId 20240 08:35:55.590780 tst mo_mt_call_osmux.py: using BVCI 20241 08:35:55.713374 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:55.725267 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:55.736649 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:55.748221 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:55.759813 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:35:55.771768 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:35:55.892483 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:35:56.016677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:56.536234 run create_hlr_db(pid=14526): Launched 08:35:56.663932 bus /sierra_2: Setting Powered False 08:35:57.729070 run create_hlr_db(pid=14526): Terminated: ok {rc=0} 08:35:58.174171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14528): Launched 08:35:58.488856 run osmo-hlr_10.42.42.2(pid=14529): Launched 08:35:58.609655 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:59.161949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14531): Launched 08:35:59.493222 run osmo-stp_10.42.42.5(pid=14532): Launched 08:35:59.640181 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:00.206807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14534): Launched 08:36:00.524142 run osmo-msc_10.42.42.6(pid=14535): Launched 08:36:00.700728 run osmo-stp_10.42.42.5(pid=14532): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14532)] 08:36:00.849911 run osmo-stp_10.42.42.5(pid=14532): stdout: | (launched: 2022-12-09_08:35:59.418773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:01.015434 run osmo-stp_10.42.42.5(pid=14532): stderr: | [0;m[38;5;43m20221209083559607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083559607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083559607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083559608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083559608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083559608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083559608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:01.147551 run osmo-stp_10.42.42.5(pid=14532): stdout: | (launched: 2022-12-09_08:35:59.418773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:01.274774 run osmo-stp_10.42.42.5(pid=14532): stderr: | [0;m[38;5;43m20221209083559607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083559607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083559607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083559608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083559608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083559608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083559608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:01.427214 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14532): Process ended prematurely: osmo-stp_10.42.42.5(pid=14532) [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14532)] [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:36:01.437269 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:36:01.465326 run osmo-hlr_10.42.42.2(pid=14529): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14529)] 08:36:01.514872 run osmo-hlr_10.42.42.2(pid=14529): stdout: | (launched: 2022-12-09_08:35:58.431528) 08:36:01.566281 run osmo-hlr_10.42.42.2(pid=14529): stderr: | [0;m[1;31m20221209083558611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083558611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083558611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083558611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083558611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083558611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083558623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083558631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083558632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083558632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:01.637956 run osmo-msc_10.42.42.6(pid=14535): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14535)] 08:36:01.687197 run osmo-msc_10.42.42.6(pid=14535): stdout: | (launched: 2022-12-09_08:36:00.467065) 08:36:01.737881 run osmo-msc_10.42.42.6(pid=14535): stderr: | [0;m[38;5;43m20221209083600742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083600742 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff023064c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083600742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083600742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083600742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083600742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083600744 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083600744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083600745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083600745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:01.789619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14528): Terminating (SIGTERM) 08:36:01.830746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14531): Terminating (SIGTERM) 08:36:01.872759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14534): Terminating (SIGTERM) 08:36:01.916140 --- ParallelTerminationStrategy: PID 14528 died... 08:36:01.936431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14528): Terminated: ok {rc=0} 08:36:01.982176 --- ParallelTerminationStrategy: PID 14531 died... 08:36:02.001909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14531): Terminated: ok {rc=0} 08:36:02.047690 --- ParallelTerminationStrategy: PID 14534 died... 08:36:02.067186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14534): Terminated: ok {rc=0} 08:36:02.154509 bus /sierra_3: Setting Powered False 08:36:03.251012 bus /sierra_3: Setting Powered False 08:36:04.367477 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:oc2g --------------------------------------------------------------------- 08:36:05.616539 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:05.620633 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 08:36:05.641786 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 08:36:05.669070 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 08:36:05.753873 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 08:36:05.774624 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 08:36:05.801438 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 08:36:06.387774 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 08:36:06.392735 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:06.403700 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:36:06.440584 tst emergency_mo_mt_call.py: using LAC 20241 08:36:06.562500 tst emergency_mo_mt_call.py: using RAC 96 08:36:06.682822 tst emergency_mo_mt_call.py: using CellId 20241 08:36:06.801779 tst emergency_mo_mt_call.py: using BVCI 20242 08:36:06.915336 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:06.926193 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:06.936831 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:06.947417 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:06.958013 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:06.968502 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:36:07.089462 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:36:07.211049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:07.722008 run create_hlr_db(pid=14541): Launched 08:36:07.850442 bus /sierra_2: Setting Powered False 08:36:08.916207 run create_hlr_db(pid=14541): Terminated: ok {rc=0} 08:36:09.354372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14543): Launched 08:36:09.661597 run osmo-hlr_10.42.42.2(pid=14544): Launched 08:36:09.778217 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:10.305771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14546): Launched 08:36:10.612021 run osmo-stp_10.42.42.5(pid=14547): Launched 08:36:10.739858 tst emergency_mo_mt_call.py: using MSISDN 7119 08:36:10.896397 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:11.445451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14549): Launched 08:36:11.751577 run osmo-msc_10.42.42.6(pid=14550): Launched 08:36:11.922796 run osmo-stp_10.42.42.5(pid=14547): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14547)] 08:36:12.051796 run osmo-stp_10.42.42.5(pid=14547): stdout: | (launched: 2022-12-09_08:36:10.555491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:12.181089 run osmo-stp_10.42.42.5(pid=14547): stderr: | [0;m[38;5;43m20221209083610728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083610728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083610728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083610729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083610729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083610729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083610729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:12.308535 run osmo-stp_10.42.42.5(pid=14547): stdout: | (launched: 2022-12-09_08:36:10.555491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:12.430307 run osmo-stp_10.42.42.5(pid=14547): stderr: | [0;m[38;5;43m20221209083610728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083610728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083610728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083610729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083610729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083610729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083610729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:12.575660 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14547): Process ended prematurely: osmo-stp_10.42.42.5(pid=14547) [trial-2357↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14547)] [trial-2357↪emergency:oc2g↪emergency_mo_mt_call.py:19] 08:36:12.583937 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 08:36:12.610579 run osmo-hlr_10.42.42.2(pid=14544): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14544)] 08:36:12.658988 run osmo-hlr_10.42.42.2(pid=14544): stdout: | (launched: 2022-12-09_08:36:09.605089) 08:36:12.708682 run osmo-hlr_10.42.42.2(pid=14544): stderr: | [0;m[1;31m20221209083609781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083609781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083609781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083609781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083609781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083609781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083609794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083609803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083609803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083609803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:12.778164 run osmo-msc_10.42.42.6(pid=14550): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14550)] 08:36:12.826415 run osmo-msc_10.42.42.6(pid=14550): stdout: | (launched: 2022-12-09_08:36:11.694880) 08:36:12.876374 run osmo-msc_10.42.42.6(pid=14550): stderr: | [0;m[38;5;43m20221209083611965 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083611966 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5e00d77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083611966 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083611966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083611966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083611966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083611968 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083611969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083611969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083611969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:12.926598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14543): Terminating (SIGTERM) 08:36:12.966228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14546): Terminating (SIGTERM) 08:36:13.005929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14549): Terminating (SIGTERM) 08:36:13.045969 --- ParallelTerminationStrategy: PID 14543 died... 08:36:13.065039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14543): Terminated: ok {rc=0} 08:36:13.109405 --- ParallelTerminationStrategy: PID 14546 died... 08:36:13.128095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14546): Terminated: ok {rc=0} 08:36:13.172481 --- ParallelTerminationStrategy: PID 14549 died... 08:36:13.191295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14549): Terminated: ok {rc=0} 08:36:13.278406 bus /sierra_3: Setting Powered False 08:36:14.379367 bus /sierra_3: Setting Powered False 08:36:15.493512 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 08:36:16.580075 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:16.593908 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:36:16.635698 tst emergency_preemptive_call.py: using LAC 20242 08:36:16.759826 tst emergency_preemptive_call.py: using RAC 97 08:36:16.941242 tst emergency_preemptive_call.py: using CellId 20242 08:36:17.066534 tst emergency_preemptive_call.py: using BVCI 20243 08:36:17.219929 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:17.232341 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:17.244515 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:17.256937 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:17.269320 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:36:17.282168 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:36:17.402898 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:36:17.522013 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:36:17.642861 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:36:17.760254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:18.237666 run create_hlr_db(pid=14552): Launched 08:36:18.366120 bus /sierra_2: Setting Powered False 08:36:19.427309 run create_hlr_db(pid=14552): Terminated: ok {rc=0} 08:36:19.875552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14554): Launched 08:36:20.206647 run osmo-hlr_10.42.42.2(pid=14555): Launched 08:36:20.333014 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:20.897426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14557): Launched 08:36:21.225829 run osmo-stp_10.42.42.5(pid=14558): Launched 08:36:21.365301 tst emergency_preemptive_call.py: using MSISDN 7120 08:36:21.536361 run osmo-msc_10.42.42.6: Starting osmo-msc 08:36:22.126327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14560): Launched 08:36:22.454767 run osmo-msc_10.42.42.6(pid=14561): Launched 08:36:22.640714 run osmo-stp_10.42.42.5(pid=14558): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14558)] 08:36:22.778798 run osmo-stp_10.42.42.5(pid=14558): stdout: | (launched: 2022-12-09_08:36:21.165779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:22.917664 run osmo-stp_10.42.42.5(pid=14558): stderr: | [0;m[38;5;43m20221209083621358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083621358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083621359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083621359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083621360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083621360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083621360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:23.055626 run osmo-stp_10.42.42.5(pid=14558): stdout: | (launched: 2022-12-09_08:36:21.165779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:23.186245 run osmo-stp_10.42.42.5(pid=14558): stderr: | [0;m[38;5;43m20221209083621358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083621358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083621359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083621359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083621360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083621360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083621360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:23.342420 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14558): Process ended prematurely: osmo-stp_10.42.42.5(pid=14558) [trial-2357↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14558)] [trial-2357↪emergency:oc2g↪emergency_preemptive_call.py:32] 08:36:23.351384 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 08:36:23.379608 run osmo-hlr_10.42.42.2(pid=14555): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14555)] 08:36:23.430084 run osmo-hlr_10.42.42.2(pid=14555): stdout: | (launched: 2022-12-09_08:36:20.146489) 08:36:23.482107 run osmo-hlr_10.42.42.2(pid=14555): stderr: | [0;m[1;31m20221209083620343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083620343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083620343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083620343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083620343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083620343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083620355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083620364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083620364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083620364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:23.554870 run osmo-msc_10.42.42.6(pid=14561): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14561)] 08:36:23.605737 run osmo-msc_10.42.42.6(pid=14561): stdout: | (launched: 2022-12-09_08:36:22.394454) 08:36:23.657990 run osmo-msc_10.42.42.6(pid=14561): stderr: | [0;m[38;5;43m20221209083622715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209083622715 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b84f72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209083622715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209083622715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209083622716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209083622716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209083622718 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209083622718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209083622718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209083622718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:36:23.710628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14554): Terminating (SIGTERM) 08:36:23.752811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14557): Terminating (SIGTERM) 08:36:23.795090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14560): Terminating (SIGTERM) 08:36:23.837495 --- ParallelTerminationStrategy: PID 14554 died... 08:36:23.857677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14554): Terminated: ok {rc=0} 08:36:23.904365 --- ParallelTerminationStrategy: PID 14557 died... 08:36:23.924118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14557): Terminated: ok {rc=0} 08:36:23.970743 --- ParallelTerminationStrategy: PID 14560 died... 08:36:23.990521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14560): Terminated: ok {rc=0} 08:36:24.079394 bus /sierra_9: Setting Powered False 08:36:25.179512 bus /sierra_9: Setting Powered False 08:36:26.297582 bus /sierra_8: Setting Powered False 08:36:27.398666 bus /sierra_8: Setting Powered False 08:36:28.515389 bus /sierra_3: Setting Powered False 08:36:29.613844 bus /sierra_3: Setting Powered False 08:36:30.732740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:oc2g --------------------------------------------------------------------- 08:36:32.013896 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:32.019823 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 08:36:32.042911 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 08:36:32.086267 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 08:36:32.179084 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 08:36:32.203135 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 08:36:32.247173 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 08:36:32.830263 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 08:36:32.881294 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:32.892047 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:36:32.928942 tst cs_paging_gprs_active.py: using LAC 20243 08:36:33.055597 tst cs_paging_gprs_active.py: using RAC 98 08:36:33.180755 tst cs_paging_gprs_active.py: using CellId 20243 08:36:33.305704 tst cs_paging_gprs_active.py: using BVCI 20244 08:36:33.420029 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.430689 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.441193 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.451573 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.461891 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.472164 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.482703 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.493065 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:33.503542 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:36:33.626249 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:36:33.746493 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:36:33.973838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:34.310594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14566): Launched 08:36:34.602475 run iperf3-srv_10.42.42.10(pid=14567): Launched 08:36:34.729603 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:36:34.955781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:35.292004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14568): Launched 08:36:35.585246 run iperf3-srv_10.42.42.10(pid=14569): Launched 08:36:35.711432 tst cs_paging_gprs_active.py:38: start network... 08:36:35.937615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:36.456375 run create_hlr_db(pid=14570): Launched 08:36:36.586497 bus /sierra_2: Setting Powered False 08:36:37.649090 run create_hlr_db(pid=14570): Terminated: ok {rc=0} 08:36:38.113732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14572): Launched 08:36:38.448817 run osmo-hlr_10.42.42.2(pid=14573): Launched 08:36:38.577578 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:39.152883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14575): Launched 08:36:39.488005 run osmo-stp_10.42.42.5(pid=14576): Launched 08:36:39.616757 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:36:40.194573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14578): Launched 08:36:40.322674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:36:40.605131 run patchelf(pid=14579): Launched 08:36:40.791948 run osmo-stp_10.42.42.5(pid=14576): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14576)] 08:36:40.932636 run osmo-stp_10.42.42.5(pid=14576): stdout: | (launched: 2022-12-09_08:36:39.427218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:41.075373 run osmo-stp_10.42.42.5(pid=14576): stderr: | [0;m[38;5;43m20221209083639620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083639620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083639620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083639621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083639621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083639621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083639622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:41.218490 run osmo-stp_10.42.42.5(pid=14576): stdout: | (launched: 2022-12-09_08:36:39.427218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:41.355097 run osmo-stp_10.42.42.5(pid=14576): stderr: | [0;m[38;5;43m20221209083639620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083639620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083639620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083639621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083639621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083639621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083639622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:41.517168 run patchelf(pid=14579): Terminating (SIGINT) 08:36:41.705169 run patchelf(pid=14579): Terminated: ok {rc=0} 08:36:41.840174 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14576): Process ended prematurely: osmo-stp_10.42.42.5(pid=14576) [trial-2357↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14576)] [trial-2357↪gprs:oc2g↪cs_paging_gprs_active.py:38] 08:36:41.850308 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:36:41.879780 run osmo-hlr_10.42.42.2(pid=14573): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14573)] 08:36:41.930416 run osmo-hlr_10.42.42.2(pid=14573): stdout: | (launched: 2022-12-09_08:36:38.387814) 08:36:41.982792 run osmo-hlr_10.42.42.2(pid=14573): stderr: | [0;m[1;31m20221209083638586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083638586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083638586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083638586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083638586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083638586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083638600 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083638609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083638609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083638609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:42.035654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14566): Terminating (SIGTERM) 08:36:42.077930 run iperf3-srv_10.42.42.10(pid=14567): Terminating (SIGTERM) 08:36:42.120262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14568): Terminating (SIGTERM) 08:36:42.162621 run iperf3-srv_10.42.42.10(pid=14569): Terminating (SIGTERM) 08:36:42.204843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14572): Terminating (SIGTERM) 08:36:42.247375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14575): Terminating (SIGTERM) 08:36:42.289737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14578): Terminating (SIGTERM) 08:36:42.332281 --- ParallelTerminationStrategy: PID 14566 died... 08:36:42.352421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14566): Terminated: ok {rc=0} 08:36:42.399350 --- ParallelTerminationStrategy: PID 14567 died... 08:36:42.418899 run iperf3-srv_10.42.42.10(pid=14567): Terminated {rc=256} 08:36:42.465457 --- ParallelTerminationStrategy: PID 14568 died... 08:36:42.484792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14568): Terminated: ok {rc=0} 08:36:42.531430 --- ParallelTerminationStrategy: PID 14569 died... 08:36:42.550938 run iperf3-srv_10.42.42.10(pid=14569): Terminated {rc=256} 08:36:42.597681 --- ParallelTerminationStrategy: PID 14572 died... 08:36:42.617336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14572): Terminated: ok {rc=0} 08:36:42.664079 --- ParallelTerminationStrategy: PID 14575 died... 08:36:42.683752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14575): Terminated: ok {rc=0} 08:36:42.730322 --- ParallelTerminationStrategy: PID 14578 died... 08:36:42.749901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14578): Terminated: ok {rc=0} 08:36:42.838410 bus /gobi_0: Setting Powered False 08:36:43.937665 bus /gobi_0: Setting Powered False 08:36:45.053944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g iperf3.py ---------------------------------------------- 08:36:46.200136 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.212092 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:36:46.249141 tst iperf3.py: using LAC 20244 08:36:46.418496 tst iperf3.py: using RAC 99 08:36:46.556355 tst iperf3.py: using CellId 20244 08:36:46.696161 tst iperf3.py: using BVCI 20245 08:36:46.822684 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.834783 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.848225 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.860308 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.874424 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.887742 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.901026 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.913328 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:46.926246 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:36:47.054110 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:36:47.284685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:47.621579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14580): Launched 08:36:47.912085 run iperf3-srv_10.42.42.10(pid=14581): Launched 08:36:48.039877 tst iperf3.py:8: start network... 08:36:48.266135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:48.787286 run create_hlr_db(pid=14582): Launched 08:36:48.914567 bus /gobi_6: Setting Powered False 08:36:49.980368 run create_hlr_db(pid=14582): Terminated: ok {rc=0} 08:36:50.443288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14584): Launched 08:36:50.780335 run osmo-hlr_10.42.42.2(pid=14585): Launched 08:36:50.908627 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:51.483646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14587): Launched 08:36:51.820154 run osmo-stp_10.42.42.5(pid=14588): Launched 08:36:51.950106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:36:52.529170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14590): Launched 08:36:52.659111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:36:52.942076 run patchelf(pid=14591): Launched 08:36:53.129124 run osmo-stp_10.42.42.5(pid=14588): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14588)] 08:36:53.270530 run osmo-stp_10.42.42.5(pid=14588): stdout: | (launched: 2022-12-09_08:36:51.759098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:53.413238 run osmo-stp_10.42.42.5(pid=14588): stderr: | [0;m[38;5;43m20221209083651951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083651951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083651951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083651952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083651952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083651952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083651952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:53.556089 run osmo-stp_10.42.42.5(pid=14588): stdout: | (launched: 2022-12-09_08:36:51.759098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:53.693893 run osmo-stp_10.42.42.5(pid=14588): stderr: | [0;m[38;5;43m20221209083651951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083651951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083651951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083651952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083651952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083651952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083651952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:53.855759 run patchelf(pid=14591): Terminating (SIGINT) 08:36:54.042412 run patchelf(pid=14591): Terminated: ok {rc=0} 08:36:54.177135 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14588): Process ended prematurely: osmo-stp_10.42.42.5(pid=14588) [trial-2357↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14588)] [trial-2357↪gprs:oc2g↪iperf3.py:8] 08:36:54.187396 tst iperf3.py:8: Test FAILED (8.0 sec) 08:36:54.216806 run osmo-hlr_10.42.42.2(pid=14585): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14585)] 08:36:54.267542 run osmo-hlr_10.42.42.2(pid=14585): stdout: | (launched: 2022-12-09_08:36:50.719424) 08:36:54.320070 run osmo-hlr_10.42.42.2(pid=14585): stderr: | [0;m[1;31m20221209083650918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083650919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083650919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083650919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083650919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083650919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083650931 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083650940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083650940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083650940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:54.373649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14580): Terminating (SIGTERM) 08:36:54.415906 run iperf3-srv_10.42.42.10(pid=14581): Terminating (SIGTERM) 08:36:54.458132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14584): Terminating (SIGTERM) 08:36:54.500439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14587): Terminating (SIGTERM) 08:36:54.542824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14590): Terminating (SIGTERM) 08:36:54.585328 --- ParallelTerminationStrategy: PID 14580 died... 08:36:54.605774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14580): Terminated: ok {rc=0} 08:36:54.653107 --- ParallelTerminationStrategy: PID 14581 died... 08:36:54.672782 run iperf3-srv_10.42.42.10(pid=14581): Terminated {rc=256} 08:36:54.719801 --- ParallelTerminationStrategy: PID 14584 died... 08:36:54.739479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14584): Terminated: ok {rc=0} 08:36:54.786683 --- ParallelTerminationStrategy: PID 14587 died... 08:36:54.806473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14587): Terminated: ok {rc=0} 08:36:54.853286 --- ParallelTerminationStrategy: PID 14590 died... 08:36:54.872813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14590): Terminated: ok {rc=0} 08:36:54.960487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g iperf3m4.py ---------------------------------------------- 08:36:56.112749 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.124883 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:36:56.163254 tst iperf3m4.py: using LAC 20245 08:36:56.294930 tst iperf3m4.py: using RAC 100 08:36:56.427129 tst iperf3m4.py: using CellId 20245 08:36:56.558541 tst iperf3m4.py: using BVCI 20246 08:36:56.680425 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.691832 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.703159 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.714749 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.726214 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.737612 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.748826 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.760166 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:36:56.771809 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:36:56.895337 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:36:57.016354 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:36:57.140042 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:36:57.260864 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:36:57.486935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:57.824505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14592): Launched 08:36:58.117734 run iperf3-srv_10.42.42.10(pid=14593): Launched 08:36:58.243051 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:36:58.468875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:58.805427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14594): Launched 08:36:59.095786 run iperf3-srv_10.42.42.10(pid=14595): Launched 08:36:59.223083 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:36:59.449653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:59.786567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14596): Launched 08:37:00.077430 run iperf3-srv_10.42.42.10(pid=14597): Launched 08:37:00.203813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:37:00.429064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:00.764668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14598): Launched 08:37:01.073419 run iperf3-srv_10.42.42.10(pid=14599): Launched 08:37:01.235408 tst iperf3m4.py:8: start network... 08:37:01.481374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:02.010049 run create_hlr_db(pid=14600): Launched 08:37:02.171569 bus /gobi_6: Setting Powered False 08:37:03.237177 run create_hlr_db(pid=14600): Terminated: ok {rc=0} 08:37:03.682286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Launched 08:37:03.994671 run osmo-hlr_10.42.42.2(pid=14603): Launched 08:37:04.114416 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:04.653114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Launched 08:37:04.964828 run osmo-stp_10.42.42.5(pid=14606): Launched 08:37:05.084227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:05.625235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14608): Launched 08:37:05.746931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:06.012203 run patchelf(pid=14609): Launched 08:37:06.186099 run osmo-stp_10.42.42.5(pid=14606): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] 08:37:06.318674 run osmo-stp_10.42.42.5(pid=14606): stdout: | (launched: 2022-12-09_08:37:04.907508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:06.452450 run osmo-stp_10.42.42.5(pid=14606): stderr: | [0;m[38;5;43m20221209083705076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083705076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083705076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083705076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083705077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083705077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083705077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:06.586459 run osmo-stp_10.42.42.5(pid=14606): stdout: | (launched: 2022-12-09_08:37:04.907508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:06.714659 run osmo-stp_10.42.42.5(pid=14606): stderr: | [0;m[38;5;43m20221209083705076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083705076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083705076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083705076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083705077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083705077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083705077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:06.866463 run patchelf(pid=14609): Terminating (SIGINT) 08:37:07.041329 run patchelf(pid=14609): Terminated: ok {rc=0} 08:37:07.167528 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14606): Process ended prematurely: osmo-stp_10.42.42.5(pid=14606) [trial-2357↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] [trial-2357↪gprs:oc2g↪iperf3m4.py:8] 08:37:07.176900 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:37:07.204592 run osmo-hlr_10.42.42.2(pid=14603): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14603)] 08:37:07.252902 run osmo-hlr_10.42.42.2(pid=14603): stdout: | (launched: 2022-12-09_08:37:03.937196) 08:37:07.302875 run osmo-hlr_10.42.42.2(pid=14603): stderr: | [0;m[1;31m20221209083704110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083704110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083704110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083704110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083704110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083704110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083704123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083704131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083704131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083704131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:07.354201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14592): Terminating (SIGTERM) 08:37:07.394836 run iperf3-srv_10.42.42.10(pid=14593): Terminating (SIGTERM) 08:37:07.435230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14594): Terminating (SIGTERM) 08:37:07.475859 run iperf3-srv_10.42.42.10(pid=14595): Terminating (SIGTERM) 08:37:07.516552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14596): Terminating (SIGTERM) 08:37:07.557143 run iperf3-srv_10.42.42.10(pid=14597): Terminating (SIGTERM) 08:37:07.597415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14598): Terminating (SIGTERM) 08:37:07.637684 run iperf3-srv_10.42.42.10(pid=14599): Terminating (SIGTERM) 08:37:07.677711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Terminating (SIGTERM) 08:37:07.718166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Terminating (SIGTERM) 08:37:07.758439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14608): Terminating (SIGTERM) 08:37:07.798940 --- ParallelTerminationStrategy: PID 14592 died... 08:37:07.818382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14592): Terminated: ok {rc=0} 08:37:07.863389 --- ParallelTerminationStrategy: PID 14593 died... 08:37:07.882467 run iperf3-srv_10.42.42.10(pid=14593): Terminated {rc=256} 08:37:07.926719 --- ParallelTerminationStrategy: PID 14594 died... 08:37:07.945726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14594): Terminated: ok {rc=0} 08:37:07.990014 --- ParallelTerminationStrategy: PID 14595 died... 08:37:08.009112 run iperf3-srv_10.42.42.10(pid=14595): Terminated {rc=256} 08:37:08.053511 --- ParallelTerminationStrategy: PID 14596 died... 08:37:08.072345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14596): Terminated: ok {rc=0} 08:37:08.117119 --- ParallelTerminationStrategy: PID 14597 died... 08:37:08.136008 run iperf3-srv_10.42.42.10(pid=14597): Terminated {rc=256} 08:37:08.180418 --- ParallelTerminationStrategy: PID 14598 died... 08:37:08.199461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14598): Terminated: ok {rc=0} 08:37:08.244475 --- ParallelTerminationStrategy: PID 14599 died... 08:37:08.263480 run iperf3-srv_10.42.42.10(pid=14599): Terminated {rc=256} 08:37:08.307833 --- ParallelTerminationStrategy: PID 14602 died... 08:37:08.326755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Terminated: ok {rc=0} 08:37:08.371693 --- ParallelTerminationStrategy: PID 14605 died... 08:37:08.390656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Terminated: ok {rc=0} 08:37:08.435203 --- ParallelTerminationStrategy: PID 14608 died... 08:37:08.454356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14608): Terminated: ok {rc=0} 08:37:08.541096 bus /gobi_4: Setting Powered False 08:37:09.643105 bus /gobi_4: Setting Powered False 08:37:10.763304 bus /gobi_1: Setting Powered False 08:37:11.863071 bus /gobi_1: Setting Powered False 08:37:12.979641 bus /gobi_0: Setting Powered False 08:37:14.079056 bus /gobi_0: Setting Powered False 08:37:15.196222 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g ping.py ---------------------------------------------- 08:37:16.301200 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.313226 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:37:16.351564 tst ping.py: using LAC 20246 08:37:16.475383 tst ping.py: using RAC 101 08:37:16.635771 tst ping.py: using CellId 20246 08:37:16.767405 tst ping.py: using BVCI 20247 08:37:16.891127 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.903317 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.916807 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.930192 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.942228 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.955508 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.969499 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:16.982612 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:37:17.106725 tst ping.py:19: start network... 08:37:17.332505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:17.844617 run create_hlr_db(pid=14610): Launched 08:37:17.971797 bus /gobi_6: Setting Powered False 08:37:19.036444 run create_hlr_db(pid=14610): Terminated: ok {rc=0} 08:37:19.492855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14612): Launched 08:37:19.824738 run osmo-hlr_10.42.42.2(pid=14613): Launched 08:37:19.952559 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:20.520419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14615): Launched 08:37:20.850461 run osmo-stp_10.42.42.5(pid=14616): Launched 08:37:20.976503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:21.544454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14618): Launched 08:37:21.670674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:21.948016 run patchelf(pid=14619): Launched 08:37:22.132754 run osmo-stp_10.42.42.5(pid=14616): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14616)] 08:37:22.271782 run osmo-stp_10.42.42.5(pid=14616): stdout: | (launched: 2022-12-09_08:37:20.790007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:22.412561 run osmo-stp_10.42.42.5(pid=14616): stderr: | [0;m[38;5;43m20221209083720979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083720979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083720979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083720980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083720980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083720980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083720980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:22.553220 run osmo-stp_10.42.42.5(pid=14616): stdout: | (launched: 2022-12-09_08:37:20.790007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:22.688892 run osmo-stp_10.42.42.5(pid=14616): stderr: | [0;m[38;5;43m20221209083720979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083720979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083720979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083720980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083720980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083720980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083720980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:22.849258 run patchelf(pid=14619): Terminating (SIGINT) 08:37:23.033274 run patchelf(pid=14619): Terminated: ok {rc=0} 08:37:23.165719 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14616): Process ended prematurely: osmo-stp_10.42.42.5(pid=14616) [trial-2357↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14616)] [trial-2357↪gprs:oc2g↪ping.py:22] 08:37:23.175202 tst ping.py:22: Test FAILED (6.9 sec) 08:37:23.204574 run osmo-hlr_10.42.42.2(pid=14613): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14613)] 08:37:23.255919 run osmo-hlr_10.42.42.2(pid=14613): stdout: | (launched: 2022-12-09_08:37:19.764080) 08:37:23.309264 run osmo-hlr_10.42.42.2(pid=14613): stderr: | [0;m[1;31m20221209083719962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083719962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083719962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083719962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083719962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083719962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083719975 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083719985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083719985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083719985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:23.362561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14612): Terminating (SIGTERM) 08:37:23.405631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14615): Terminating (SIGTERM) 08:37:23.448478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14618): Terminating (SIGTERM) 08:37:23.491496 --- ParallelTerminationStrategy: PID 14612 died... 08:37:23.511838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14612): Terminated: ok {rc=0} 08:37:23.559406 --- ParallelTerminationStrategy: PID 14615 died... 08:37:23.579462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14615): Terminated: ok {rc=0} 08:37:23.626965 --- ParallelTerminationStrategy: PID 14618 died... 08:37:23.647113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14618): Terminated: ok {rc=0} 08:37:23.736155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 08:37:24.826251 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:24.838277 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:37:24.876189 tst ping_idle_ping.py: using LAC 20247 08:37:25.006373 tst ping_idle_ping.py: using RAC 102 08:37:25.137227 tst ping_idle_ping.py: using CellId 20247 08:37:25.267917 tst ping_idle_ping.py: using BVCI 20248 08:37:25.387927 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:25.399112 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:25.410446 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:25.422016 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:25.433384 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:25.444731 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:25.456256 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:37:25.467613 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:37:25.587980 tst ping_idle_ping.py:24: start network... 08:37:25.794474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:26.274798 run create_hlr_db(pid=14620): Launched 08:37:26.401931 bus /gobi_6: Setting Powered False 08:37:27.464155 run create_hlr_db(pid=14620): Terminated: ok {rc=0} 08:37:27.915626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14622): Launched 08:37:28.248161 run osmo-hlr_10.42.42.2(pid=14623): Launched 08:37:28.374453 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:28.943416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14625): Launched 08:37:29.275076 run osmo-stp_10.42.42.5(pid=14626): Launched 08:37:29.402792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:29.972711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14628): Launched 08:37:30.100014 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:30.378528 run patchelf(pid=14629): Launched 08:37:30.562863 run osmo-stp_10.42.42.5(pid=14626): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14626)] 08:37:30.703444 run osmo-stp_10.42.42.5(pid=14626): stdout: | (launched: 2022-12-09_08:37:29.214511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:30.845181 run osmo-stp_10.42.42.5(pid=14626): stderr: | [0;m[38;5;43m20221209083729407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083729407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083729407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083729408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083729408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083729408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083729408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:30.994916 run osmo-stp_10.42.42.5(pid=14626): stdout: | (launched: 2022-12-09_08:37:29.214511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:31.133928 run osmo-stp_10.42.42.5(pid=14626): stderr: | [0;m[38;5;43m20221209083729407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083729407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083729407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083729408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083729408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083729408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083729408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:31.298344 run patchelf(pid=14629): Terminating (SIGINT) 08:37:31.487162 run patchelf(pid=14629): Terminated: ok {rc=0} 08:37:31.624220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14626): Process ended prematurely: osmo-stp_10.42.42.5(pid=14626) [trial-2357↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14626)] [trial-2357↪gprs:oc2g↪ping_idle_ping.py:27] 08:37:31.635097 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:37:31.667430 run osmo-hlr_10.42.42.2(pid=14623): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14623)] 08:37:31.720847 run osmo-hlr_10.42.42.2(pid=14623): stdout: | (launched: 2022-12-09_08:37:28.187308) 08:37:31.775818 run osmo-hlr_10.42.42.2(pid=14623): stderr: | [0;m[1;31m20221209083728386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083728386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083728386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083728386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083728386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083728386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083728398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083728407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083728407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083728408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:31.831645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14622): Terminating (SIGTERM) 08:37:31.876657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14625): Terminating (SIGTERM) 08:37:31.922123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14628): Terminating (SIGTERM) 08:37:31.969342 --- ParallelTerminationStrategy: PID 14622 died... 08:37:31.990449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14622): Terminated: ok {rc=0} 08:37:32.041863 --- ParallelTerminationStrategy: PID 14625 died... 08:37:32.062657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14625): Terminated: ok {rc=0} 08:37:32.112832 --- ParallelTerminationStrategy: PID 14628 died... 08:37:32.133695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14628): Terminated: ok {rc=0} 08:37:32.225362 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 08:37:33.519421 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:33.524498 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:37:33.545526 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:37:33.584650 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:37:33.672713 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:37:33.693495 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:37:33.732128 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:37:34.327646 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:37:34.376745 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.387587 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:37:34.427629 tst cs_paging_gprs_active.py: using LAC 20248 08:37:34.547592 tst cs_paging_gprs_active.py: using RAC 103 08:37:34.666092 tst cs_paging_gprs_active.py: using CellId 20248 08:37:34.785137 tst cs_paging_gprs_active.py: using BVCI 20249 08:37:34.896876 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.907827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.918586 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.929302 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.939790 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.950341 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.961121 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.971693 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:34.982431 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:37:35.103378 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:37:35.223379 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:37:35.430926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:35.740392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14634): Launched 08:37:36.024744 run iperf3-srv_10.42.42.10(pid=14636): Launched 08:37:36.147955 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:37:36.370183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:36.700523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14637): Launched 08:37:36.985549 run iperf3-srv_10.42.42.10(pid=14638): Launched 08:37:37.109284 tst cs_paging_gprs_active.py:38: start network... 08:37:37.330471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:37.841817 run create_hlr_db(pid=14639): Launched 08:37:37.968733 bus /gobi_6: Setting Powered False 08:37:39.033683 run create_hlr_db(pid=14639): Terminated: ok {rc=0} 08:37:39.473407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14641): Launched 08:37:39.781265 run osmo-hlr_10.42.42.2(pid=14642): Launched 08:37:39.898913 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:40.442613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14644): Launched 08:37:40.750267 run osmo-stp_10.42.42.5(pid=14645): Launched 08:37:40.870477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:41.402907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14647): Launched 08:37:41.520040 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:41.780589 run patchelf(pid=14648): Launched 08:37:41.951114 run osmo-stp_10.42.42.5(pid=14645): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14645)] 08:37:42.080881 run osmo-stp_10.42.42.5(pid=14645): stdout: | (launched: 2022-12-09_08:37:40.693943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:42.212346 run osmo-stp_10.42.42.5(pid=14645): stderr: | [0;m[38;5;43m20221209083740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083740865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083740865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083740866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083740866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:42.343575 run osmo-stp_10.42.42.5(pid=14645): stdout: | (launched: 2022-12-09_08:37:40.693943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:42.469421 run osmo-stp_10.42.42.5(pid=14645): stderr: | [0;m[38;5;43m20221209083740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083740864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083740865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083740865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083740865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083740866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083740866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:42.618420 run patchelf(pid=14648): Terminating (SIGINT) 08:37:42.790150 run patchelf(pid=14648): Terminated: ok {rc=0} 08:37:42.913923 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14645): Process ended prematurely: osmo-stp_10.42.42.5(pid=14645) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14645)] [trial-2357↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:37:42.923437 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:37:42.950545 run osmo-hlr_10.42.42.2(pid=14642): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14642)] 08:37:42.998432 run osmo-hlr_10.42.42.2(pid=14642): stdout: | (launched: 2022-12-09_08:37:39.725091) 08:37:43.047917 run osmo-hlr_10.42.42.2(pid=14642): stderr: | [0;m[1;31m20221209083739902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083739902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083739902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083739902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083739902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083739902 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083739916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083739926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083739927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083739927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:43.097984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14634): Terminating (SIGTERM) 08:37:43.138182 run iperf3-srv_10.42.42.10(pid=14636): Terminating (SIGTERM) 08:37:43.178320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14637): Terminating (SIGTERM) 08:37:43.218514 run iperf3-srv_10.42.42.10(pid=14638): Terminating (SIGTERM) 08:37:43.258506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14641): Terminating (SIGTERM) 08:37:43.298673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14644): Terminating (SIGTERM) 08:37:43.338931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14647): Terminating (SIGTERM) 08:37:43.379465 --- ParallelTerminationStrategy: PID 14634 died... 08:37:43.398654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14634): Terminated: ok {rc=0} 08:37:43.442877 --- ParallelTerminationStrategy: PID 14636 died... 08:37:43.461566 run iperf3-srv_10.42.42.10(pid=14636): Terminated {rc=256} 08:37:43.505481 --- ParallelTerminationStrategy: PID 14637 died... 08:37:43.524089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14637): Terminated: ok {rc=0} 08:37:43.568602 --- ParallelTerminationStrategy: PID 14638 died... 08:37:43.587270 run iperf3-srv_10.42.42.10(pid=14638): Terminated {rc=256} 08:37:43.631549 --- ParallelTerminationStrategy: PID 14641 died... 08:37:43.650375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14641): Terminated: ok {rc=0} 08:37:43.694696 --- ParallelTerminationStrategy: PID 14644 died... 08:37:43.713366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14644): Terminated: ok {rc=0} 08:37:43.757362 --- ParallelTerminationStrategy: PID 14647 died... 08:37:43.776335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14647): Terminated: ok {rc=0} 08:37:43.863264 bus /gobi_0: Setting Powered False 08:37:44.965113 bus /gobi_0: Setting Powered False 08:37:46.101733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:37:47.255553 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.268058 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:37:47.307320 tst iperf3.py: using LAC 20249 08:37:47.429918 tst iperf3.py: using RAC 104 08:37:47.550876 tst iperf3.py: using CellId 20249 08:37:47.674533 tst iperf3.py: using BVCI 20250 08:37:47.795615 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.807295 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.818849 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.831222 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.843143 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.855096 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.867445 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.879977 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:47.892385 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:37:48.016539 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:37:48.238188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:48.567178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14649): Launched 08:37:48.852473 run iperf3-srv_10.42.42.10(pid=14650): Launched 08:37:48.975114 tst iperf3.py:8: start network... 08:37:49.195384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:49.705411 run create_hlr_db(pid=14651): Launched 08:37:49.831627 bus /gobi_6: Setting Powered False 08:37:50.896128 run create_hlr_db(pid=14651): Terminated: ok {rc=0} 08:37:51.351373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14653): Launched 08:37:51.681829 run osmo-hlr_10.42.42.2(pid=14654): Launched 08:37:51.807759 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:52.370013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14656): Launched 08:37:52.700558 run osmo-stp_10.42.42.5(pid=14657): Launched 08:37:52.827037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:53.392532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14659): Launched 08:37:53.517794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:53.795291 run patchelf(pid=14660): Launched 08:37:53.978045 run osmo-stp_10.42.42.5(pid=14657): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14657)] 08:37:54.116655 run osmo-stp_10.42.42.5(pid=14657): stdout: | (launched: 2022-12-09_08:37:52.640387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:54.256591 run osmo-stp_10.42.42.5(pid=14657): stderr: | [0;m[38;5;43m20221209083752833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083752833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083752833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083752834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083752834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083752834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083752834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:54.397026 run osmo-stp_10.42.42.5(pid=14657): stdout: | (launched: 2022-12-09_08:37:52.640387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:54.531372 run osmo-stp_10.42.42.5(pid=14657): stderr: | [0;m[38;5;43m20221209083752833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083752833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083752833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083752834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083752834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083752834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083752834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:54.691632 run patchelf(pid=14660): Terminating (SIGINT) 08:37:54.874642 run patchelf(pid=14660): Terminated: ok {rc=0} 08:37:55.006881 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14657): Process ended prematurely: osmo-stp_10.42.42.5(pid=14657) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14657)] [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 08:37:55.017697 tst iperf3.py:8: Test FAILED (7.8 sec) 08:37:55.046753 run osmo-hlr_10.42.42.2(pid=14654): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14654)] 08:37:55.097607 run osmo-hlr_10.42.42.2(pid=14654): stdout: | (launched: 2022-12-09_08:37:51.621626) 08:37:55.149929 run osmo-hlr_10.42.42.2(pid=14654): stderr: | [0;m[1;31m20221209083751820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083751820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083751820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083751820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083751820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083751821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083751833 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083751841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083751841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083751841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:55.202998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14649): Terminating (SIGTERM) 08:37:55.245477 run iperf3-srv_10.42.42.10(pid=14650): Terminating (SIGTERM) 08:37:55.287905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14653): Terminating (SIGTERM) 08:37:55.330602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14656): Terminating (SIGTERM) 08:37:55.373156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14659): Terminating (SIGTERM) 08:37:55.415742 --- ParallelTerminationStrategy: PID 14649 died... 08:37:55.435908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14649): Terminated: ok {rc=0} 08:37:55.483043 --- ParallelTerminationStrategy: PID 14650 died... 08:37:55.502749 run iperf3-srv_10.42.42.10(pid=14650): Terminated {rc=256} 08:37:55.549570 --- ParallelTerminationStrategy: PID 14653 died... 08:37:55.569195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14653): Terminated: ok {rc=0} 08:37:55.615899 --- ParallelTerminationStrategy: PID 14656 died... 08:37:55.635981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14656): Terminated: ok {rc=0} 08:37:55.683156 --- ParallelTerminationStrategy: PID 14659 died... 08:37:55.702990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14659): Terminated: ok {rc=0} 08:37:55.793422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:37:56.946278 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:56.958594 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:37:57.001337 tst iperf3m4.py: using LAC 20250 08:37:57.129369 tst iperf3m4.py: using RAC 105 08:37:57.267749 tst iperf3m4.py: using CellId 20250 08:37:57.399280 tst iperf3m4.py: using BVCI 20251 08:37:57.518349 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.529920 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.541214 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.552544 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.563867 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.575159 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.586833 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.598210 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:37:57.610036 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:37:57.734518 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:37:57.857516 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:37:57.977573 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:37:58.096689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:37:58.303166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:58.612435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14661): Launched 08:37:58.879862 run iperf3-srv_10.42.42.10(pid=14662): Launched 08:37:58.994880 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:37:59.200332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:59.508349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14663): Launched 08:37:59.776692 run iperf3-srv_10.42.42.10(pid=14664): Launched 08:37:59.891665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:38:00.097084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:38:00.405938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14665): Launched 08:38:00.675043 run iperf3-srv_10.42.42.10(pid=14666): Launched 08:38:00.789735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:38:01.004579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:38:01.317541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14667): Launched 08:38:01.614131 run iperf3-srv_10.42.42.10(pid=14677): Launched 08:38:01.770467 tst iperf3m4.py:8: start network... 08:38:02.012039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:02.549027 run create_hlr_db(pid=14712): Launched 08:38:02.717777 bus /gobi_6: Setting Powered False 08:38:03.799119 run create_hlr_db(pid=14712): Terminated: ok {rc=0} 08:38:04.263135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14941): Launched 08:38:04.612121 run osmo-hlr_10.42.42.2(pid=14942): Launched 08:38:04.867642 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:05.548270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14944): Launched 08:38:05.901684 run osmo-stp_10.42.42.5(pid=14946): Launched 08:38:06.136020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:06.780433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14949): Launched 08:38:06.922248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:07.207452 run patchelf(pid=14950): Launched 08:38:07.407933 run osmo-stp_10.42.42.5(pid=14946): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14946)] 08:38:07.550995 run osmo-stp_10.42.42.5(pid=14946): stdout: | (launched: 2022-12-09_08:38:05.837056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:07.698195 run osmo-stp_10.42.42.5(pid=14946): stderr: | [0;m[38;5;43m20221209083806155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083806155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083806155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083806156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083806156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083806156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083806156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:07.843583 run osmo-stp_10.42.42.5(pid=14946): stdout: | (launched: 2022-12-09_08:38:05.837056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:07.981473 run osmo-stp_10.42.42.5(pid=14946): stderr: | [0;m[38;5;43m20221209083806155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083806155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083806155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083806156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083806156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083806156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083806156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:08.146033 run patchelf(pid=14950): Terminating (SIGINT) 08:38:08.334152 run patchelf(pid=14950): Terminated: ok {rc=0} 08:38:08.471645 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14946): Process ended prematurely: osmo-stp_10.42.42.5(pid=14946) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14946)] [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 08:38:08.483044 tst iperf3m4.py:8: Test FAILED (11.6 sec) 08:38:08.515704 run osmo-hlr_10.42.42.2(pid=14942): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14942)] 08:38:08.569368 run osmo-hlr_10.42.42.2(pid=14942): stdout: | (launched: 2022-12-09_08:38:04.550273) 08:38:08.625467 run osmo-hlr_10.42.42.2(pid=14942): stderr: | [0;m[1;31m20221209083804856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083804856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083804856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083804856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083804856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083804856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083804873 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083804882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083804882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083804882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:08.681689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14661): Terminating (SIGTERM) 08:38:08.727860 run iperf3-srv_10.42.42.10(pid=14662): Terminating (SIGTERM) 08:38:08.775997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14663): Terminating (SIGTERM) 08:38:08.822733 run iperf3-srv_10.42.42.10(pid=14664): Terminating (SIGTERM) 08:38:08.870702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14665): Terminating (SIGTERM) 08:38:08.917032 run iperf3-srv_10.42.42.10(pid=14666): Terminating (SIGTERM) 08:38:08.965541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14667): Terminating (SIGTERM) 08:38:09.011928 run iperf3-srv_10.42.42.10(pid=14677): Terminating (SIGTERM) 08:38:09.057381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14941): Terminating (SIGTERM) 08:38:09.103158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14944): Terminating (SIGTERM) 08:38:09.150559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14949): Terminating (SIGTERM) 08:38:09.199794 --- ParallelTerminationStrategy: PID 14661 died... 08:38:09.221434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14661): Terminated: ok {rc=0} 08:38:09.273335 --- ParallelTerminationStrategy: PID 14662 died... 08:38:09.294368 run iperf3-srv_10.42.42.10(pid=14662): Terminated {rc=256} 08:38:09.345384 --- ParallelTerminationStrategy: PID 14663 died... 08:38:09.366693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14663): Terminated: ok {rc=0} 08:38:09.418486 --- ParallelTerminationStrategy: PID 14664 died... 08:38:09.439396 run iperf3-srv_10.42.42.10(pid=14664): Terminated {rc=256} 08:38:09.490078 --- ParallelTerminationStrategy: PID 14665 died... 08:38:09.511639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14665): Terminated: ok {rc=0} 08:38:09.562458 --- ParallelTerminationStrategy: PID 14666 died... 08:38:09.583437 run iperf3-srv_10.42.42.10(pid=14666): Terminated {rc=256} 08:38:09.635046 --- ParallelTerminationStrategy: PID 14667 died... 08:38:09.656097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14667): Terminated: ok {rc=0} 08:38:09.707929 --- ParallelTerminationStrategy: PID 14677 died... 08:38:09.729006 run iperf3-srv_10.42.42.10(pid=14677): Terminated {rc=256} 08:38:09.778945 --- ParallelTerminationStrategy: PID 14941 died... 08:38:09.800912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14941): Terminated: ok {rc=0} 08:38:09.851740 --- ParallelTerminationStrategy: PID 14944 died... 08:38:09.872704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14944): Terminated: ok {rc=0} 08:38:09.923351 --- ParallelTerminationStrategy: PID 14949 died... 08:38:09.944473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14949): Terminated: ok {rc=0} 08:38:10.039843 bus /gobi_4: Setting Powered False 08:38:11.144873 bus /gobi_4: Setting Powered False 08:38:12.268311 bus /gobi_1: Setting Powered False 08:38:13.372591 bus /gobi_1: Setting Powered False 08:38:14.496127 bus /gobi_0: Setting Powered False 08:38:15.603724 bus /gobi_0: Setting Powered False 08:38:16.760869 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 08:38:17.892922 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:17.908451 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:38:17.950376 tst ping.py: using LAC 20251 08:38:18.080904 tst ping.py: using RAC 106 08:38:18.211505 tst ping.py: using CellId 20251 08:38:18.341600 tst ping.py: using BVCI 20252 08:38:18.465195 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:18.477760 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:18.490618 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:18.505066 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:18.517285 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:18.531061 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:18.546059 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:18.560255 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:38:18.680443 tst ping.py:19: start network... 08:38:18.885477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:19.361758 run create_hlr_db(pid=14951): Launched 08:38:19.528197 bus /gobi_6: Setting Powered False 08:38:20.595952 run create_hlr_db(pid=14951): Terminated: ok {rc=0} 08:38:21.061869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14953): Launched 08:38:21.407350 run osmo-hlr_10.42.42.2(pid=14954): Launched 08:38:21.656643 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:22.337830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14956): Launched 08:38:22.685508 run osmo-stp_10.42.42.5(pid=14957): Launched 08:38:22.933813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:23.587271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14959): Launched 08:38:23.727833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:24.009965 run patchelf(pid=14960): Launched 08:38:24.206992 run osmo-stp_10.42.42.5(pid=14957): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14957)] 08:38:24.349257 run osmo-stp_10.42.42.5(pid=14957): stdout: | (launched: 2022-12-09_08:38:22.624833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:24.494840 run osmo-stp_10.42.42.5(pid=14957): stderr: | [0;m[38;5;43m20221209083822913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083822913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083822914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083822914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083822915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083822915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083822915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:24.641682 run osmo-stp_10.42.42.5(pid=14957): stdout: | (launched: 2022-12-09_08:38:22.624833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:24.780872 run osmo-stp_10.42.42.5(pid=14957): stderr: | [0;m[38;5;43m20221209083822913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083822913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083822914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083822914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083822915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083822915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083822915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:24.940240 run patchelf(pid=14960): Terminating (SIGINT) 08:38:25.109311 run patchelf(pid=14960): Terminated: ok {rc=0} 08:38:25.231479 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14957): Process ended prematurely: osmo-stp_10.42.42.5(pid=14957) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14957)] [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 08:38:25.240384 tst ping.py:22: Test FAILED (7.3 sec) 08:38:25.267343 run osmo-hlr_10.42.42.2(pid=14954): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14954)] 08:38:25.315556 run osmo-hlr_10.42.42.2(pid=14954): stdout: | (launched: 2022-12-09_08:38:21.346302) 08:38:25.366169 run osmo-hlr_10.42.42.2(pid=14954): stderr: | [0;m[1;31m20221209083821657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083821657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083821657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083821657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083821657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083821657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083821669 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083821686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083821686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083821686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:25.416657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14953): Terminating (SIGTERM) 08:38:25.457294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14956): Terminating (SIGTERM) 08:38:25.497873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14959): Terminating (SIGTERM) 08:38:25.538689 --- ParallelTerminationStrategy: PID 14953 died... 08:38:25.558198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14953): Terminated: ok {rc=0} 08:38:25.602964 --- ParallelTerminationStrategy: PID 14956 died... 08:38:25.622078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14956): Terminated: ok {rc=0} 08:38:25.666641 --- ParallelTerminationStrategy: PID 14959 died... 08:38:25.685512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14959): Terminated: ok {rc=0} 08:38:25.772293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:38:26.862746 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:26.875023 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:38:26.913474 tst ping_idle_ping.py: using LAC 20252 08:38:27.037029 tst ping_idle_ping.py: using RAC 107 08:38:27.155530 tst ping_idle_ping.py: using CellId 20252 08:38:27.273154 tst ping_idle_ping.py: using BVCI 20253 08:38:27.382465 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:27.393486 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:27.404283 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:27.415127 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:27.425814 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:27.436536 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:27.447394 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:38:27.458236 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:38:27.574394 tst ping_idle_ping.py:24: start network... 08:38:27.775970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:28.250064 run create_hlr_db(pid=14961): Launched 08:38:28.373920 bus /gobi_6: Setting Powered False 08:38:29.434387 run create_hlr_db(pid=14961): Terminated: ok {rc=0} 08:38:29.879582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14963): Launched 08:38:30.207935 run osmo-hlr_10.42.42.2(pid=14964): Launched 08:38:30.332934 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:30.905666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14966): Launched 08:38:31.233660 run osmo-stp_10.42.42.5(pid=14967): Launched 08:38:31.479403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:32.078300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14969): Launched 08:38:32.213074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:32.473440 run patchelf(pid=14970): Launched 08:38:32.644101 run osmo-stp_10.42.42.5(pid=14967): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14967)] 08:38:32.772355 run osmo-stp_10.42.42.5(pid=14967): stdout: | (launched: 2022-12-09_08:38:31.174126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:32.902134 run osmo-stp_10.42.42.5(pid=14967): stderr: | [0;m[38;5;43m20221209083831453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083831453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083831453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083831454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083831454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083831454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083831454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:33.032306 run osmo-stp_10.42.42.5(pid=14967): stdout: | (launched: 2022-12-09_08:38:31.174126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:33.156554 run osmo-stp_10.42.42.5(pid=14967): stderr: | [0;m[38;5;43m20221209083831453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083831453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083831453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083831454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083831454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083831454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083831454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:33.304423 run patchelf(pid=14970): Terminating (SIGINT) 08:38:33.474046 run patchelf(pid=14970): Terminated: ok {rc=0} 08:38:33.596351 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14967): Process ended prematurely: osmo-stp_10.42.42.5(pid=14967) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14967)] [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 08:38:33.605330 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:38:33.631979 run osmo-hlr_10.42.42.2(pid=14964): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14964)] 08:38:33.679951 run osmo-hlr_10.42.42.2(pid=14964): stdout: | (launched: 2022-12-09_08:38:30.148428) 08:38:33.729649 run osmo-hlr_10.42.42.2(pid=14964): stderr: | [0;m[1;31m20221209083830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083830345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083830358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083830367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083830367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083830367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:33.779655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14963): Terminating (SIGTERM) 08:38:33.819653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14966): Terminating (SIGTERM) 08:38:33.859436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14969): Terminating (SIGTERM) 08:38:33.899625 --- ParallelTerminationStrategy: PID 14963 died... 08:38:33.918853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14963): Terminated: ok {rc=0} 08:38:33.963211 --- ParallelTerminationStrategy: PID 14966 died... 08:38:33.982022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14966): Terminated: ok {rc=0} 08:38:34.027179 --- ParallelTerminationStrategy: PID 14969 died... 08:38:34.046171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14969): Terminated: ok {rc=0} 08:38:34.132888 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:38:35.432615 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:35.440379 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:38:35.463286 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:38:35.504864 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:38:35.597480 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:38:35.619511 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:38:35.661553 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:38:36.257151 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:38:36.311606 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.323076 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:38:36.382767 tst cs_paging_gprs_active.py: using LAC 20253 08:38:36.513371 tst cs_paging_gprs_active.py: using RAC 108 08:38:36.642852 tst cs_paging_gprs_active.py: using CellId 20253 08:38:36.773901 tst cs_paging_gprs_active.py: using BVCI 20254 08:38:36.895619 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.907227 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.918461 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.930393 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.942248 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.954213 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.966322 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.978126 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:36.990452 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:38:37.110919 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:38:37.229716 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:38:37.439385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:38:37.750951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14974): Launched 08:38:38.022570 run iperf3-srv_10.42.42.10(pid=14975): Launched 08:38:38.141409 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:38:38.348422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:38:38.659538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14976): Launched 08:38:38.929181 run iperf3-srv_10.42.42.10(pid=14977): Launched 08:38:39.044493 tst cs_paging_gprs_active.py:38: start network... 08:38:39.251800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:39.731896 run create_hlr_db(pid=14978): Launched 08:38:39.858847 bus /gobi_6: Setting Powered False 08:38:40.920046 run create_hlr_db(pid=14978): Terminated: ok {rc=0} 08:38:41.369936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14980): Launched 08:38:41.702000 run osmo-hlr_10.42.42.2(pid=14981): Launched 08:38:41.829575 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:42.398023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14983): Launched 08:38:42.729350 run osmo-stp_10.42.42.5(pid=14984): Launched 08:38:42.856270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:43.425370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14986): Launched 08:38:43.551865 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:43.831256 run patchelf(pid=14987): Launched 08:38:44.015874 run osmo-stp_10.42.42.5(pid=14984): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14984)] 08:38:44.155742 run osmo-stp_10.42.42.5(pid=14984): stdout: | (launched: 2022-12-09_08:38:42.669102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:44.296340 run osmo-stp_10.42.42.5(pid=14984): stderr: | [0;m[38;5;43m20221209083842861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083842861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083842861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083842862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083842862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083842862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083842862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:44.437424 run osmo-stp_10.42.42.5(pid=14984): stdout: | (launched: 2022-12-09_08:38:42.669102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:44.572727 run osmo-stp_10.42.42.5(pid=14984): stderr: | [0;m[38;5;43m20221209083842861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083842861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083842861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083842862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083842862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083842862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083842862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:44.733700 run patchelf(pid=14987): Terminating (SIGINT) 08:38:44.918231 run patchelf(pid=14987): Terminated: ok {rc=0} 08:38:45.051644 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14984): Process ended prematurely: osmo-stp_10.42.42.5(pid=14984) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14984)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:38:45.061805 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:38:45.090885 run osmo-hlr_10.42.42.2(pid=14981): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14981)] 08:38:45.141256 run osmo-hlr_10.42.42.2(pid=14981): stdout: | (launched: 2022-12-09_08:38:41.641399) 08:38:45.193334 run osmo-hlr_10.42.42.2(pid=14981): stderr: | [0;m[1;31m20221209083841839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083841839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083841839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083841839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083841839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083841839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083841851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083841859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083841860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083841860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:45.245994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14974): Terminating (SIGTERM) 08:38:45.288125 run iperf3-srv_10.42.42.10(pid=14975): Terminating (SIGTERM) 08:38:45.330305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14976): Terminating (SIGTERM) 08:38:45.372377 run iperf3-srv_10.42.42.10(pid=14977): Terminating (SIGTERM) 08:38:45.414367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14980): Terminating (SIGTERM) 08:38:45.456806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14983): Terminating (SIGTERM) 08:38:45.498964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14986): Terminating (SIGTERM) 08:38:45.541180 --- ParallelTerminationStrategy: PID 14974 died... 08:38:45.561147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14974): Terminated: ok {rc=0} 08:38:45.607617 --- ParallelTerminationStrategy: PID 14975 died... 08:38:45.626916 run iperf3-srv_10.42.42.10(pid=14975): Terminated {rc=256} 08:38:45.673478 --- ParallelTerminationStrategy: PID 14976 died... 08:38:45.692699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14976): Terminated: ok {rc=0} 08:38:45.738875 --- ParallelTerminationStrategy: PID 14977 died... 08:38:45.758202 run iperf3-srv_10.42.42.10(pid=14977): Terminated {rc=256} 08:38:45.804115 --- ParallelTerminationStrategy: PID 14980 died... 08:38:45.823567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14980): Terminated: ok {rc=0} 08:38:45.878398 --- ParallelTerminationStrategy: PID 14983 died... 08:38:45.898447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14983): Terminated: ok {rc=0} 08:38:45.945501 --- ParallelTerminationStrategy: PID 14986 died... 08:38:45.965340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14986): Terminated: ok {rc=0} 08:38:46.060000 bus /gobi_0: Setting Powered False 08:38:47.171752 bus /gobi_0: Setting Powered False 08:38:48.300154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:38:49.451715 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:49.463872 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:38:49.525667 tst iperf3.py: using LAC 20254 08:38:49.655760 tst iperf3.py: using RAC 109 08:38:49.784526 tst iperf3.py: using CellId 20254 08:38:49.913380 tst iperf3.py: using BVCI 20255 08:38:50.035343 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.046916 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.058321 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.069882 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.081367 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.092804 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.104514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.116045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:50.127652 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:38:50.249052 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:38:50.473395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:38:50.804873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14988): Launched 08:38:51.091474 run iperf3-srv_10.42.42.10(pid=14989): Launched 08:38:51.215440 tst iperf3.py:8: start network... 08:38:51.438389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:51.950427 run create_hlr_db(pid=14990): Launched 08:38:52.076681 bus /gobi_6: Setting Powered False 08:38:53.141938 run create_hlr_db(pid=14990): Terminated: ok {rc=0} 08:38:53.581330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14992): Launched 08:38:53.890389 run osmo-hlr_10.42.42.2(pid=14993): Launched 08:38:54.009290 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:54.554895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14995): Launched 08:38:54.863310 run osmo-stp_10.42.42.5(pid=14996): Launched 08:38:54.981096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:55.512909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14998): Launched 08:38:55.630003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:55.890203 run patchelf(pid=14999): Launched 08:38:56.062918 run osmo-stp_10.42.42.5(pid=14996): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14996)] 08:38:56.193305 run osmo-stp_10.42.42.5(pid=14996): stdout: | (launched: 2022-12-09_08:38:54.806797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:56.325093 run osmo-stp_10.42.42.5(pid=14996): stderr: | [0;m[38;5;43m20221209083854977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083854977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083854978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083854978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083854978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083854979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083854979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:56.457132 run osmo-stp_10.42.42.5(pid=14996): stdout: | (launched: 2022-12-09_08:38:54.806797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:56.590476 run osmo-stp_10.42.42.5(pid=14996): stderr: | [0;m[38;5;43m20221209083854977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083854977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083854978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083854978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083854978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083854979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083854979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:56.735848 run patchelf(pid=14999): Terminating (SIGINT) 08:38:56.903505 run patchelf(pid=14999): Terminated: ok {rc=0} 08:38:57.024434 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14996): Process ended prematurely: osmo-stp_10.42.42.5(pid=14996) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14996)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 08:38:57.033950 tst iperf3.py:8: Test FAILED (7.6 sec) 08:38:57.060404 run osmo-hlr_10.42.42.2(pid=14993): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14993)] 08:38:57.107650 run osmo-hlr_10.42.42.2(pid=14993): stdout: | (launched: 2022-12-09_08:38:53.834124) 08:38:57.156336 run osmo-hlr_10.42.42.2(pid=14993): stderr: | [0;m[1;31m20221209083854009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083854009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083854009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083854009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083854010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083854010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083854022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083854030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083854030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083854030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:57.205696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14988): Terminating (SIGTERM) 08:38:57.245189 run iperf3-srv_10.42.42.10(pid=14989): Terminating (SIGTERM) 08:38:57.284502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14992): Terminating (SIGTERM) 08:38:57.323995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14995): Terminating (SIGTERM) 08:38:57.363389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14998): Terminating (SIGTERM) 08:38:57.402993 --- ParallelTerminationStrategy: PID 14988 died... 08:38:57.421969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14988): Terminated: ok {rc=0} 08:38:57.466098 --- ParallelTerminationStrategy: PID 14989 died... 08:38:57.484740 run iperf3-srv_10.42.42.10(pid=14989): Terminated {rc=256} 08:38:57.528258 --- ParallelTerminationStrategy: PID 14992 died... 08:38:57.546745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14992): Terminated: ok {rc=0} 08:38:57.589985 --- ParallelTerminationStrategy: PID 14995 died... 08:38:57.608364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14995): Terminated: ok {rc=0} 08:38:57.652446 --- ParallelTerminationStrategy: PID 14998 died... 08:38:57.671234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14998): Terminated: ok {rc=0} 08:38:57.757693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:38:58.904340 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:58.916020 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:38:58.973513 tst iperf3m4.py: using LAC 20255 08:38:59.093540 tst iperf3m4.py: using RAC 110 08:38:59.221308 tst iperf3m4.py: using CellId 20255 08:38:59.347644 tst iperf3m4.py: using BVCI 20256 08:38:59.458202 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.469521 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.480446 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.491214 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.502136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.512912 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.523958 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.534696 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:38:59.545593 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:38:59.666778 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:38:59.787096 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:38:59.902285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:39:00.018104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:39:00.220265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:00.522854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15000): Launched 08:39:00.785696 run iperf3-srv_10.42.42.10(pid=15001): Launched 08:39:00.922969 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:39:01.179907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:01.490205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15002): Launched 08:39:01.776393 run iperf3-srv_10.42.42.10(pid=15003): Launched 08:39:01.903015 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:39:02.107811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:02.414106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15004): Launched 08:39:02.677484 run iperf3-srv_10.42.42.10(pid=15005): Launched 08:39:02.790165 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:39:02.990892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:03.293539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15006): Launched 08:39:03.556175 run iperf3-srv_10.42.42.10(pid=15007): Launched 08:39:03.669445 tst iperf3m4.py:8: start network... 08:39:03.871549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:04.342477 run create_hlr_db(pid=15008): Launched 08:39:04.465394 bus /gobi_6: Setting Powered False 08:39:05.529460 run create_hlr_db(pid=15008): Terminated: ok {rc=0} 08:39:05.978982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15010): Launched 08:39:06.302444 run osmo-hlr_10.42.42.2(pid=15011): Launched 08:39:06.427278 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:06.992733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15013): Launched 08:39:07.313709 run osmo-stp_10.42.42.5(pid=15014): Launched 08:39:07.437972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:08.003901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15016): Launched 08:39:08.127796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:08.403791 run patchelf(pid=15017): Launched 08:39:08.585472 run osmo-stp_10.42.42.5(pid=15014): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15014)] 08:39:08.724642 run osmo-stp_10.42.42.5(pid=15014): stdout: | (launched: 2022-12-09_08:39:07.255512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:08.864472 run osmo-stp_10.42.42.5(pid=15014): stderr: | [0;m[38;5;43m20221209083907441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083907442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083907442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083907442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083907443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083907443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083907443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:09.004936 run osmo-stp_10.42.42.5(pid=15014): stdout: | (launched: 2022-12-09_08:39:07.255512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:09.139697 run osmo-stp_10.42.42.5(pid=15014): stderr: | [0;m[38;5;43m20221209083907441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083907442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083907442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083907442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083907443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083907443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083907443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:09.299228 run patchelf(pid=15017): Terminating (SIGINT) 08:39:09.483121 run patchelf(pid=15017): Terminated: ok {rc=0} 08:39:09.615213 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15014): Process ended prematurely: osmo-stp_10.42.42.5(pid=15014) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15014)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:39:09.625251 tst iperf3m4.py:8: Test FAILED (10.8 sec) 08:39:09.654790 run osmo-hlr_10.42.42.2(pid=15011): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15011)] 08:39:09.706371 run osmo-hlr_10.42.42.2(pid=15011): stdout: | (launched: 2022-12-09_08:39:06.243256) 08:39:09.758951 run osmo-hlr_10.42.42.2(pid=15011): stderr: | [0;m[1;31m20221209083906438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083906438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083906438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083906438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083906439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083906439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083906450 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083906459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083906460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083906460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:09.811786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15000): Terminating (SIGTERM) 08:39:09.854344 run iperf3-srv_10.42.42.10(pid=15001): Terminating (SIGTERM) 08:39:09.896816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15002): Terminating (SIGTERM) 08:39:09.939236 run iperf3-srv_10.42.42.10(pid=15003): Terminating (SIGTERM) 08:39:09.981625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15004): Terminating (SIGTERM) 08:39:10.024222 run iperf3-srv_10.42.42.10(pid=15005): Terminating (SIGTERM) 08:39:10.066810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15006): Terminating (SIGTERM) 08:39:10.109499 run iperf3-srv_10.42.42.10(pid=15007): Terminating (SIGTERM) 08:39:10.151914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15010): Terminating (SIGTERM) 08:39:10.194588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15013): Terminating (SIGTERM) 08:39:10.237101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15016): Terminating (SIGTERM) 08:39:10.279506 --- ParallelTerminationStrategy: PID 15000 died... 08:39:10.299659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15000): Terminated: ok {rc=0} 08:39:10.347162 --- ParallelTerminationStrategy: PID 15001 died... 08:39:10.366899 run iperf3-srv_10.42.42.10(pid=15001): Terminated {rc=256} 08:39:10.413806 --- ParallelTerminationStrategy: PID 15002 died... 08:39:10.433558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15002): Terminated: ok {rc=0} 08:39:10.480607 --- ParallelTerminationStrategy: PID 15003 died... 08:39:10.500416 run iperf3-srv_10.42.42.10(pid=15003): Terminated {rc=256} 08:39:10.547788 --- ParallelTerminationStrategy: PID 15004 died... 08:39:10.567537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15004): Terminated: ok {rc=0} 08:39:10.614796 --- ParallelTerminationStrategy: PID 15005 died... 08:39:10.634576 run iperf3-srv_10.42.42.10(pid=15005): Terminated {rc=256} 08:39:10.681474 --- ParallelTerminationStrategy: PID 15006 died... 08:39:10.701509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15006): Terminated: ok {rc=0} 08:39:10.748470 --- ParallelTerminationStrategy: PID 15007 died... 08:39:10.768159 run iperf3-srv_10.42.42.10(pid=15007): Terminated {rc=256} 08:39:10.815113 --- ParallelTerminationStrategy: PID 15010 died... 08:39:10.834868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15010): Terminated: ok {rc=0} 08:39:10.881577 --- ParallelTerminationStrategy: PID 15013 died... 08:39:10.901495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15013): Terminated: ok {rc=0} 08:39:10.948299 --- ParallelTerminationStrategy: PID 15016 died... 08:39:10.968077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15016): Terminated: ok {rc=0} 08:39:11.056232 bus /gobi_4: Setting Powered False 08:39:12.155319 bus /gobi_4: Setting Powered False 08:39:13.270058 bus /gobi_1: Setting Powered False 08:39:14.366875 bus /gobi_1: Setting Powered False 08:39:15.480097 bus /gobi_0: Setting Powered False 08:39:16.581120 bus /gobi_0: Setting Powered False 08:39:17.701880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:39:18.804830 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:18.816493 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:39:18.873559 tst ping.py: using LAC 20256 08:39:18.991717 tst ping.py: using RAC 111 08:39:19.108891 tst ping.py: using CellId 20256 08:39:19.229917 tst ping.py: using BVCI 20257 08:39:19.340190 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:19.351309 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:19.362169 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:19.372869 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:19.383703 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:19.394410 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:19.405417 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:19.416163 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:39:19.530603 tst ping.py:19: start network... 08:39:19.733143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:20.199527 run create_hlr_db(pid=15018): Launched 08:39:20.323859 bus /gobi_6: Setting Powered False 08:39:21.387291 run create_hlr_db(pid=15018): Terminated: ok {rc=0} 08:39:21.834979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15020): Launched 08:39:22.157417 run osmo-hlr_10.42.42.2(pid=15021): Launched 08:39:22.281097 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:22.840045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15023): Launched 08:39:23.161281 run osmo-stp_10.42.42.5(pid=15024): Launched 08:39:23.285526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:23.840799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15026): Launched 08:39:23.963399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:24.234954 run patchelf(pid=15027): Launched 08:39:24.413319 run osmo-stp_10.42.42.5(pid=15024): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15024)] 08:39:24.549940 run osmo-stp_10.42.42.5(pid=15024): stdout: | (launched: 2022-12-09_08:39:23.102447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:24.687993 run osmo-stp_10.42.42.5(pid=15024): stderr: | [0;m[38;5;43m20221209083923290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083923291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083923291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083923291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083923292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083923292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083923292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:24.826347 run osmo-stp_10.42.42.5(pid=15024): stdout: | (launched: 2022-12-09_08:39:23.102447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:24.958699 run osmo-stp_10.42.42.5(pid=15024): stderr: | [0;m[38;5;43m20221209083923290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083923291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083923291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083923291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083923292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083923292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083923292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:25.115287 run patchelf(pid=15027): Terminating (SIGINT) 08:39:25.295620 run patchelf(pid=15027): Terminated: ok {rc=0} 08:39:25.425677 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15024): Process ended prematurely: osmo-stp_10.42.42.5(pid=15024) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15024)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 08:39:25.435369 tst ping.py:22: Test FAILED (6.6 sec) 08:39:25.464054 run osmo-hlr_10.42.42.2(pid=15021): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15021)] 08:39:25.514494 run osmo-hlr_10.42.42.2(pid=15021): stdout: | (launched: 2022-12-09_08:39:22.099021) 08:39:25.566833 run osmo-hlr_10.42.42.2(pid=15021): stderr: | [0;m[1;31m20221209083922294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083922294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083922294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083922294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083922294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083922294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083922307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083922315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083922315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083922315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:25.619849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15020): Terminating (SIGTERM) 08:39:25.662361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15023): Terminating (SIGTERM) 08:39:25.705256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15026): Terminating (SIGTERM) 08:39:25.747946 --- ParallelTerminationStrategy: PID 15020 died... 08:39:25.768024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15020): Terminated: ok {rc=0} 08:39:25.815668 --- ParallelTerminationStrategy: PID 15023 died... 08:39:25.835574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15023): Terminated: ok {rc=0} 08:39:25.882510 --- ParallelTerminationStrategy: PID 15026 died... 08:39:25.902076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15026): Terminated: ok {rc=0} 08:39:25.991422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:39:27.080112 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.092921 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:39:27.153921 tst ping_idle_ping.py: using LAC 20257 08:39:27.277254 tst ping_idle_ping.py: using RAC 112 08:39:27.404047 tst ping_idle_ping.py: using CellId 20257 08:39:27.531522 tst ping_idle_ping.py: using BVCI 20258 08:39:27.643045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.654247 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.665442 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.676272 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.688089 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.699618 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.711506 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:39:27.722939 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:39:27.843738 tst ping_idle_ping.py:24: start network... 08:39:28.059677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:28.559423 run create_hlr_db(pid=15028): Launched 08:39:28.684023 bus /gobi_6: Setting Powered False 08:39:29.748383 run create_hlr_db(pid=15028): Terminated: ok {rc=0} 08:39:30.178288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15030): Launched 08:39:30.478843 run osmo-hlr_10.42.42.2(pid=15031): Launched 08:39:30.594813 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:31.171219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15033): Launched 08:39:31.489266 run osmo-stp_10.42.42.5(pid=15034): Launched 08:39:31.771250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:32.333097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15036): Launched 08:39:32.457726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:32.730200 run patchelf(pid=15037): Launched 08:39:32.910097 run osmo-stp_10.42.42.5(pid=15034): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15034)] 08:39:33.046954 run osmo-stp_10.42.42.5(pid=15034): stdout: | (launched: 2022-12-09_08:39:31.431758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:33.185154 run osmo-stp_10.42.42.5(pid=15034): stderr: | [0;m[38;5;43m20221209083931624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083931624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083931624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083931625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083931625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083931626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083931626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:33.323612 run osmo-stp_10.42.42.5(pid=15034): stdout: | (launched: 2022-12-09_08:39:31.431758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:33.455954 run osmo-stp_10.42.42.5(pid=15034): stderr: | [0;m[38;5;43m20221209083931624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083931624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083931624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083931625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083931625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083931626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083931626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:33.612302 run patchelf(pid=15037): Terminating (SIGINT) 08:39:33.792625 run patchelf(pid=15037): Terminated: ok {rc=0} 08:39:33.922472 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15034): Process ended prematurely: osmo-stp_10.42.42.5(pid=15034) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15034)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:39:33.932207 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:39:33.961362 run osmo-hlr_10.42.42.2(pid=15031): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15031)] 08:39:34.012373 run osmo-hlr_10.42.42.2(pid=15031): stdout: | (launched: 2022-12-09_08:39:30.422827) 08:39:34.065067 run osmo-hlr_10.42.42.2(pid=15031): stderr: | [0;m[1;31m20221209083930595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083930595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083930595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083930595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083930595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083930595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083930611 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083930621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083930622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083930622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:34.117896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15030): Terminating (SIGTERM) 08:39:34.160530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15033): Terminating (SIGTERM) 08:39:34.203432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15036): Terminating (SIGTERM) 08:39:34.246375 --- ParallelTerminationStrategy: PID 15030 died... 08:39:34.266623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15030): Terminated: ok {rc=0} 08:39:34.314120 --- ParallelTerminationStrategy: PID 15033 died... 08:39:34.333962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15033): Terminated: ok {rc=0} 08:39:34.381564 --- ParallelTerminationStrategy: PID 15036 died... 08:39:34.401455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15036): Terminated: ok {rc=0} 08:39:34.490124 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:39:35.793115 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:39:35.799574 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:39:35.822391 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:39:35.863085 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:39:35.953197 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:39:35.974684 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:39:36.015477 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:39:36.613470 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:39:36.666466 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:36.678482 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:39:36.737380 tst cs_paging_gprs_active.py: using LAC 20258 08:39:36.864289 tst cs_paging_gprs_active.py: using RAC 113 08:39:36.991912 tst cs_paging_gprs_active.py: using CellId 20258 08:39:37.113359 tst cs_paging_gprs_active.py: using BVCI 20259 08:39:37.223263 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.234454 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.245372 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.256471 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.267188 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.278022 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.288749 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.299394 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:37.310136 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:39:37.431528 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:39:37.555868 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:39:37.761527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:38.065827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15041): Launched 08:39:38.329744 run iperf3-srv_10.42.42.10(pid=15042): Launched 08:39:38.443513 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:39:38.647923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:38.953389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15043): Launched 08:39:39.217368 run iperf3-srv_10.42.42.10(pid=15044): Launched 08:39:39.330912 tst cs_paging_gprs_active.py:38: start network... 08:39:39.534183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:40.005398 run create_hlr_db(pid=15045): Launched 08:39:40.128848 bus /gobi_6: Setting Powered False 08:39:41.188768 run create_hlr_db(pid=15045): Terminated: ok {rc=0} 08:39:41.631240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15047): Launched 08:39:41.955646 run osmo-hlr_10.42.42.2(pid=15048): Launched 08:39:42.079424 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:42.643220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15050): Launched 08:39:42.967502 run osmo-stp_10.42.42.5(pid=15051): Launched 08:39:43.091189 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:43.648883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15053): Launched 08:39:43.773132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:44.047025 run patchelf(pid=15054): Launched 08:39:44.226928 run osmo-stp_10.42.42.5(pid=15051): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15051)] 08:39:44.363869 run osmo-stp_10.42.42.5(pid=15051): stdout: | (launched: 2022-12-09_08:39:42.909099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:44.502755 run osmo-stp_10.42.42.5(pid=15051): stderr: | [0;m[38;5;43m20221209083943094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083943094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083943095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083943095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083943095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083943095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083943096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:44.641992 run osmo-stp_10.42.42.5(pid=15051): stdout: | (launched: 2022-12-09_08:39:42.909099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:44.775631 run osmo-stp_10.42.42.5(pid=15051): stderr: | [0;m[38;5;43m20221209083943094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083943094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083943095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083943095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083943095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083943095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083943096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:44.932932 run patchelf(pid=15054): Terminating (SIGINT) 08:39:45.114384 run patchelf(pid=15054): Terminated: ok {rc=0} 08:39:45.244914 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15051): Process ended prematurely: osmo-stp_10.42.42.5(pid=15051) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15051)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:39:45.255224 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:39:45.284048 run osmo-hlr_10.42.42.2(pid=15048): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15048)] 08:39:45.334351 run osmo-hlr_10.42.42.2(pid=15048): stdout: | (launched: 2022-12-09_08:39:41.897065) 08:39:45.385951 run osmo-hlr_10.42.42.2(pid=15048): stderr: | [0;m[1;31m20221209083942090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083942090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083942090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083942090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083942090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083942090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083942101 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083942110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083942110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083942110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:45.438321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15041): Terminating (SIGTERM) 08:39:45.480314 run iperf3-srv_10.42.42.10(pid=15042): Terminating (SIGTERM) 08:39:45.522461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15043): Terminating (SIGTERM) 08:39:45.564720 run iperf3-srv_10.42.42.10(pid=15044): Terminating (SIGTERM) 08:39:45.606372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15047): Terminating (SIGTERM) 08:39:45.648475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15050): Terminating (SIGTERM) 08:39:45.690782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15053): Terminating (SIGTERM) 08:39:45.733093 --- ParallelTerminationStrategy: PID 15041 died... 08:39:45.752928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15041): Terminated: ok {rc=0} 08:39:45.799442 --- ParallelTerminationStrategy: PID 15042 died... 08:39:45.818577 run iperf3-srv_10.42.42.10(pid=15042): Terminated {rc=256} 08:39:45.868303 --- ParallelTerminationStrategy: PID 15043 died... 08:39:45.889694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15043): Terminated: ok {rc=0} 08:39:45.943453 --- ParallelTerminationStrategy: PID 15044 died... 08:39:45.963222 run iperf3-srv_10.42.42.10(pid=15044): Terminated {rc=256} 08:39:46.010487 --- ParallelTerminationStrategy: PID 15047 died... 08:39:46.030366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15047): Terminated: ok {rc=0} 08:39:46.078340 --- ParallelTerminationStrategy: PID 15050 died... 08:39:46.098413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15050): Terminated: ok {rc=0} 08:39:46.145616 --- ParallelTerminationStrategy: PID 15053 died... 08:39:46.165587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15053): Terminated: ok {rc=0} 08:39:46.254294 bus /gobi_0: Setting Powered False 08:39:47.351979 bus /gobi_0: Setting Powered False 08:39:48.467240 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:39:49.617581 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:49.629853 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:39:49.692272 tst iperf3.py: using LAC 20259 08:39:49.822709 tst iperf3.py: using RAC 114 08:39:49.948414 tst iperf3.py: using CellId 20259 08:39:50.072673 tst iperf3.py: using BVCI 20260 08:39:50.189350 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.201150 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.212459 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.223675 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.235243 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.246757 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.258320 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.269612 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:50.281297 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:39:50.398699 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:39:50.604293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:39:50.908721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15055): Launched 08:39:51.171841 run iperf3-srv_10.42.42.10(pid=15056): Launched 08:39:51.285366 tst iperf3.py:8: start network... 08:39:51.488225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:51.958232 run create_hlr_db(pid=15057): Launched 08:39:52.083597 bus /gobi_6: Setting Powered False 08:39:53.144162 run create_hlr_db(pid=15057): Terminated: ok {rc=0} 08:39:53.565718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15059): Launched 08:39:53.866731 run osmo-hlr_10.42.42.2(pid=15060): Launched 08:39:53.981776 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:54.503350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15062): Launched 08:39:54.805708 run osmo-stp_10.42.42.5(pid=15064): Launched 08:39:54.920926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:39:55.440936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15066): Launched 08:39:55.556329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:39:55.812235 run patchelf(pid=15067): Launched 08:39:55.979674 run osmo-stp_10.42.42.5(pid=15064): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15064)] 08:39:56.107963 run osmo-stp_10.42.42.5(pid=15064): stdout: | (launched: 2022-12-09_08:39:54.750466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:56.237943 run osmo-stp_10.42.42.5(pid=15064): stderr: | [0;m[38;5;43m20221209083954916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083954916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083954916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083954917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083954917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083954917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083954917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:56.368080 run osmo-stp_10.42.42.5(pid=15064): stdout: | (launched: 2022-12-09_08:39:54.750466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:56.492369 run osmo-stp_10.42.42.5(pid=15064): stderr: | [0;m[38;5;43m20221209083954916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209083954916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209083954916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209083954917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209083954917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209083954917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209083954917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:56.639583 run patchelf(pid=15067): Terminating (SIGINT) 08:39:56.810864 run patchelf(pid=15067): Terminated: ok {rc=0} 08:39:56.933409 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15064): Process ended prematurely: osmo-stp_10.42.42.5(pid=15064) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15064)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 08:39:56.942988 tst iperf3.py:8: Test FAILED (7.4 sec) 08:39:56.970038 run osmo-hlr_10.42.42.2(pid=15060): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15060)] 08:39:57.017737 run osmo-hlr_10.42.42.2(pid=15060): stdout: | (launched: 2022-12-09_08:39:53.812141) 08:39:57.066946 run osmo-hlr_10.42.42.2(pid=15060): stderr: | [0;m[1;31m20221209083953984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209083953984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209083953984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209083953984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209083953984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209083953984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209083953996 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209083954006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209083954006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209083954006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:57.116924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15055): Terminating (SIGTERM) 08:39:57.156926 run iperf3-srv_10.42.42.10(pid=15056): Terminating (SIGTERM) 08:39:57.196841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15059): Terminating (SIGTERM) 08:39:57.236781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15062): Terminating (SIGTERM) 08:39:57.276609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15066): Terminating (SIGTERM) 08:39:57.316405 --- ParallelTerminationStrategy: PID 15055 died... 08:39:57.335522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15055): Terminated: ok {rc=0} 08:39:57.380062 --- ParallelTerminationStrategy: PID 15056 died... 08:39:57.398844 run iperf3-srv_10.42.42.10(pid=15056): Terminated {rc=256} 08:39:57.442568 --- ParallelTerminationStrategy: PID 15059 died... 08:39:57.461140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15059): Terminated: ok {rc=0} 08:39:57.505685 --- ParallelTerminationStrategy: PID 15062 died... 08:39:57.524277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15062): Terminated: ok {rc=0} 08:39:57.568531 --- ParallelTerminationStrategy: PID 15066 died... 08:39:57.587338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15066): Terminated: ok {rc=0} 08:39:57.670764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:39:58.820485 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:58.833078 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:39:58.893150 tst iperf3m4.py: using LAC 20260 08:39:59.020202 tst iperf3m4.py: using RAC 115 08:39:59.155713 tst iperf3m4.py: using CellId 20260 08:39:59.282294 tst iperf3m4.py: using BVCI 20261 08:39:59.393704 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.405154 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.416069 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.427286 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.438490 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.449724 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.461057 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.472110 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:39:59.483493 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:39:59.600492 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:39:59.722906 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:39:59.845435 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:39:59.967251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:40:00.186145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:00.510597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15068): Launched 08:40:00.794634 run iperf3-srv_10.42.42.10(pid=15069): Launched 08:40:00.919180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:40:01.141479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:01.500542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15074): Launched 08:40:01.796463 run iperf3-srv_10.42.42.10(pid=15075): Launched 08:40:01.939453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:40:02.163501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:02.495960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15082): Launched 08:40:02.804720 run iperf3-srv_10.42.42.10(pid=15083): Launched 08:40:02.926969 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:40:03.145746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:40:03.470433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15084): Launched 08:40:03.754294 run iperf3-srv_10.42.42.10(pid=15085): Launched 08:40:03.875011 tst iperf3m4.py:8: start network... 08:40:04.092934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:04.595563 run create_hlr_db(pid=15086): Launched 08:40:04.718572 bus /gobi_6: Setting Powered False 08:40:05.782218 run create_hlr_db(pid=15086): Terminated: ok {rc=0} 08:40:06.231370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Launched 08:40:06.554495 run osmo-hlr_10.42.42.2(pid=15089): Launched 08:40:06.678608 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:07.236503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Launched 08:40:07.559567 run osmo-stp_10.42.42.5(pid=15092): Launched 08:40:07.692760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:08.249023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15094): Launched 08:40:08.373504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:08.648492 run patchelf(pid=15095): Launched 08:40:08.831616 run osmo-stp_10.42.42.5(pid=15092): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] 08:40:08.970705 run osmo-stp_10.42.42.5(pid=15092): stdout: | (launched: 2022-12-09_08:40:07.501092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:09.111700 run osmo-stp_10.42.42.5(pid=15092): stderr: | [0;m[38;5;43m20221209084007688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084007688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084007688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084007688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084007689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084007689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084007689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:09.252215 run osmo-stp_10.42.42.5(pid=15092): stdout: | (launched: 2022-12-09_08:40:07.501092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:09.386950 run osmo-stp_10.42.42.5(pid=15092): stderr: | [0;m[38;5;43m20221209084007688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084007688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084007688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084007688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084007689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084007689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084007689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:09.547045 run patchelf(pid=15095): Terminating (SIGINT) 08:40:09.731568 run patchelf(pid=15095): Terminated: ok {rc=0} 08:40:09.864726 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15092): Process ended prematurely: osmo-stp_10.42.42.5(pid=15092) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:40:09.874935 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:40:09.904367 run osmo-hlr_10.42.42.2(pid=15089): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15089)] 08:40:09.955267 run osmo-hlr_10.42.42.2(pid=15089): stdout: | (launched: 2022-12-09_08:40:06.495619) 08:40:10.007555 run osmo-hlr_10.42.42.2(pid=15089): stderr: | [0;m[1;31m20221209084006690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084006690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084006690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084006690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084006690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084006690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084006717 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084006726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084006727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084006727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:10.060330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15068): Terminating (SIGTERM) 08:40:10.102913 run iperf3-srv_10.42.42.10(pid=15069): Terminating (SIGTERM) 08:40:10.145186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15074): Terminating (SIGTERM) 08:40:10.187478 run iperf3-srv_10.42.42.10(pid=15075): Terminating (SIGTERM) 08:40:10.229604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15082): Terminating (SIGTERM) 08:40:10.271872 run iperf3-srv_10.42.42.10(pid=15083): Terminating (SIGTERM) 08:40:10.313912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15084): Terminating (SIGTERM) 08:40:10.356039 run iperf3-srv_10.42.42.10(pid=15085): Terminating (SIGTERM) 08:40:10.398110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Terminating (SIGTERM) 08:40:10.440307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Terminating (SIGTERM) 08:40:10.482540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15094): Terminating (SIGTERM) 08:40:10.524898 --- ParallelTerminationStrategy: PID 15068 died... 08:40:10.544887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15068): Terminated: ok {rc=0} 08:40:10.591820 --- ParallelTerminationStrategy: PID 15069 died... 08:40:10.611277 run iperf3-srv_10.42.42.10(pid=15069): Terminated {rc=256} 08:40:10.657966 --- ParallelTerminationStrategy: PID 15074 died... 08:40:10.677638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15074): Terminated: ok {rc=0} 08:40:10.724576 --- ParallelTerminationStrategy: PID 15075 died... 08:40:10.744165 run iperf3-srv_10.42.42.10(pid=15075): Terminated {rc=256} 08:40:10.790739 --- ParallelTerminationStrategy: PID 15082 died... 08:40:10.810355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15082): Terminated: ok {rc=0} 08:40:10.857064 --- ParallelTerminationStrategy: PID 15083 died... 08:40:10.876484 run iperf3-srv_10.42.42.10(pid=15083): Terminated {rc=256} 08:40:10.923039 --- ParallelTerminationStrategy: PID 15084 died... 08:40:10.942678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15084): Terminated: ok {rc=0} 08:40:10.989544 --- ParallelTerminationStrategy: PID 15085 died... 08:40:11.009177 run iperf3-srv_10.42.42.10(pid=15085): Terminated {rc=256} 08:40:11.055741 --- ParallelTerminationStrategy: PID 15088 died... 08:40:11.075453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15088): Terminated: ok {rc=0} 08:40:11.122185 --- ParallelTerminationStrategy: PID 15091 died... 08:40:11.141777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15091): Terminated: ok {rc=0} 08:40:11.188308 --- ParallelTerminationStrategy: PID 15094 died... 08:40:11.208005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15094): Terminated: ok {rc=0} 08:40:11.296569 bus /gobi_4: Setting Powered False 08:40:12.396786 bus /gobi_4: Setting Powered False 08:40:13.518054 bus /gobi_1: Setting Powered False 08:40:14.625861 bus /gobi_1: Setting Powered False 08:40:15.744782 bus /gobi_0: Setting Powered False 08:40:16.846376 bus /gobi_0: Setting Powered False 08:40:17.968555 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:40:19.074449 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.086485 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:40:19.145337 tst ping.py: using LAC 20261 08:40:19.265058 tst ping.py: using RAC 116 08:40:19.383748 tst ping.py: using CellId 20261 08:40:19.503614 tst ping.py: using BVCI 20262 08:40:19.614595 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.625818 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.636641 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.647480 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.658300 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.669053 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.679937 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:19.690768 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:40:19.808259 tst ping.py:19: start network... 08:40:20.010478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:20.477351 run create_hlr_db(pid=15447): Launched 08:40:20.600850 bus /gobi_6: Setting Powered False 08:40:21.661114 run create_hlr_db(pid=15447): Terminated: ok {rc=0} 08:40:22.103990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15449): Launched 08:40:22.428026 run osmo-hlr_10.42.42.2(pid=15450): Launched 08:40:22.552687 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:23.122536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15459): Launched 08:40:23.447261 run osmo-stp_10.42.42.5(pid=15526): Launched 08:40:23.695628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:24.275053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15630): Launched 08:40:24.411626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:24.688789 run patchelf(pid=15631): Launched 08:40:24.883607 run osmo-stp_10.42.42.5(pid=15526): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15526)] 08:40:25.023766 run osmo-stp_10.42.42.5(pid=15526): stdout: | (launched: 2022-12-09_08:40:23.387005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:25.165556 run osmo-stp_10.42.42.5(pid=15526): stderr: | [0;m[38;5;43m20221209084023600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084023600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084023601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084023601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084023602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084023602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084023602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:25.307575 run osmo-stp_10.42.42.5(pid=15526): stdout: | (launched: 2022-12-09_08:40:23.387005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:25.443995 run osmo-stp_10.42.42.5(pid=15526): stderr: | [0;m[38;5;43m20221209084023600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084023600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084023601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084023601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084023602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084023602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084023602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:25.605316 run patchelf(pid=15631): Terminating (SIGINT) 08:40:25.790218 run patchelf(pid=15631): Terminated: ok {rc=0} 08:40:25.925285 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15526): Process ended prematurely: osmo-stp_10.42.42.5(pid=15526) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15526)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 08:40:25.936046 tst ping.py:22: Test FAILED (6.9 sec) 08:40:25.968111 run osmo-hlr_10.42.42.2(pid=15450): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15450)] 08:40:26.021461 run osmo-hlr_10.42.42.2(pid=15450): stdout: | (launched: 2022-12-09_08:40:22.369112) 08:40:26.076525 run osmo-hlr_10.42.42.2(pid=15450): stderr: | [0;m[1;31m20221209084022564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084022564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084022564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084022564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084022564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084022564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084022581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084022590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084022590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084022591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:26.132249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15449): Terminating (SIGTERM) 08:40:26.178021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15459): Terminating (SIGTERM) 08:40:26.225028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15630): Terminating (SIGTERM) 08:40:26.272011 --- ParallelTerminationStrategy: PID 15449 died... 08:40:26.293331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15449): Terminated: ok {rc=0} 08:40:26.345079 --- ParallelTerminationStrategy: PID 15459 died... 08:40:26.366447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15459): Terminated: ok {rc=0} 08:40:26.416699 --- ParallelTerminationStrategy: PID 15630 died... 08:40:26.437594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15630): Terminated: ok {rc=0} 08:40:26.530739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:40:27.626848 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:27.640218 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:40:27.704843 tst ping_idle_ping.py: using LAC 20262 08:40:27.840314 tst ping_idle_ping.py: using RAC 117 08:40:27.969635 tst ping_idle_ping.py: using CellId 20262 08:40:28.100689 tst ping_idle_ping.py: using BVCI 20263 08:40:28.226364 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:28.239002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:28.252457 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:28.265967 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:28.278283 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:28.291559 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:28.305855 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:40:28.319331 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:40:28.449196 tst ping_idle_ping.py:24: start network... 08:40:28.677513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:29.203033 run create_hlr_db(pid=15633): Launched 08:40:29.327850 bus /gobi_6: Setting Powered False 08:40:30.391203 run create_hlr_db(pid=15633): Terminated: ok {rc=0} 08:40:30.823073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15635): Launched 08:40:31.146629 run osmo-hlr_10.42.42.2(pid=15636): Launched 08:40:31.387992 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:32.007453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15638): Launched 08:40:32.353186 run osmo-stp_10.42.42.5(pid=15639): Launched 08:40:32.469795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:33.008845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15641): Launched 08:40:33.124733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:33.380341 run patchelf(pid=15642): Launched 08:40:33.548744 run osmo-stp_10.42.42.5(pid=15639): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15639)] 08:40:33.677450 run osmo-stp_10.42.42.5(pid=15639): stdout: | (launched: 2022-12-09_08:40:32.297351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:33.808014 run osmo-stp_10.42.42.5(pid=15639): stderr: | [0;m[38;5;43m20221209084032467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084032467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084032467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084032468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084032468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084032468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084032468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:33.938537 run osmo-stp_10.42.42.5(pid=15639): stdout: | (launched: 2022-12-09_08:40:32.297351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:34.063392 run osmo-stp_10.42.42.5(pid=15639): stderr: | [0;m[38;5;43m20221209084032467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084032467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084032467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084032468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084032468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084032468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084032468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:34.211148 run patchelf(pid=15642): Terminating (SIGINT) 08:40:34.380677 run patchelf(pid=15642): Terminated: ok {rc=0} 08:40:34.503057 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15639): Process ended prematurely: osmo-stp_10.42.42.5(pid=15639) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15639)] [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:40:34.511923 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 08:40:34.538571 run osmo-hlr_10.42.42.2(pid=15636): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15636)] 08:40:34.586541 run osmo-hlr_10.42.42.2(pid=15636): stdout: | (launched: 2022-12-09_08:40:31.090264) 08:40:34.636347 run osmo-hlr_10.42.42.2(pid=15636): stderr: | [0;m[1;31m20221209084031425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084031425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084031426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084031426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084031426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084031426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084031447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084031461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084031461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084031461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:34.686464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15635): Terminating (SIGTERM) 08:40:34.726999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15638): Terminating (SIGTERM) 08:40:34.767506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15641): Terminating (SIGTERM) 08:40:34.808091 --- ParallelTerminationStrategy: PID 15635 died... 08:40:34.827542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15635): Terminated: ok {rc=0} 08:40:34.872138 --- ParallelTerminationStrategy: PID 15638 died... 08:40:34.890834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15638): Terminated: ok {rc=0} 08:40:34.935027 --- ParallelTerminationStrategy: PID 15641 died... 08:40:34.954131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15641): Terminated: ok {rc=0} 08:40:35.040748 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:40:36.341951 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:36.350244 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:40:36.371505 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:40:36.406767 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:40:36.459081 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:40:36.479796 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:40:36.514468 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:40:37.076092 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:40:37.081148 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.092412 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:40:37.147907 tst switch_tch_pdch.py: using LAC 20263 08:40:37.275692 tst switch_tch_pdch.py: using RAC 118 08:40:37.401755 tst switch_tch_pdch.py: using CellId 20263 08:40:37.519835 tst switch_tch_pdch.py: using BVCI 20264 08:40:37.629215 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.640557 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.652102 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.663288 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.674260 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.685346 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.696539 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:40:37.707656 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:40:37.830099 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:40:37.947976 tst switch_tch_pdch.py:51: start network... 08:40:38.151475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:38.622906 run create_hlr_db(pid=15647): Launched 08:40:38.747379 bus /gobi_6: Setting Powered False 08:40:39.807487 run create_hlr_db(pid=15647): Terminated: ok {rc=0} 08:40:40.248136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15649): Launched 08:40:40.571192 run osmo-hlr_10.42.42.2(pid=15650): Launched 08:40:40.697096 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:41.259662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15652): Launched 08:40:41.583421 run osmo-stp_10.42.42.5(pid=15653): Launched 08:40:41.707322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:42.265643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15655): Launched 08:40:42.390521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:42.663299 run patchelf(pid=15656): Launched 08:40:42.842789 run osmo-stp_10.42.42.5(pid=15653): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15653)] 08:40:42.979512 run osmo-stp_10.42.42.5(pid=15653): stdout: | (launched: 2022-12-09_08:40:41.524261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:43.117940 run osmo-stp_10.42.42.5(pid=15653): stderr: | [0;m[38;5;43m20221209084041714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084041714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084041715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084041715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084041715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084041715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:43.255835 run osmo-stp_10.42.42.5(pid=15653): stdout: | (launched: 2022-12-09_08:40:41.524261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:43.388453 run osmo-stp_10.42.42.5(pid=15653): stderr: | [0;m[38;5;43m20221209084041714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084041714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084041715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084041715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084041715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084041715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:43.545541 run patchelf(pid=15656): Terminating (SIGINT) 08:40:43.726101 run patchelf(pid=15656): Terminated: ok {rc=0} 08:40:43.856043 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15653): Process ended prematurely: osmo-stp_10.42.42.5(pid=15653) [trial-2357↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15653)] [trial-2357↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:40:43.865479 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 08:40:43.893742 run osmo-hlr_10.42.42.2(pid=15650): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15650)] 08:40:43.944811 run osmo-hlr_10.42.42.2(pid=15650): stdout: | (launched: 2022-12-09_08:40:40.512155) 08:40:43.997267 run osmo-hlr_10.42.42.2(pid=15650): stderr: | [0;m[1;31m20221209084040707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084040707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084040707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084040707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084040707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084040707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084040719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084040728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084040728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084040728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:44.050076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15649): Terminating (SIGTERM) 08:40:44.092489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15652): Terminating (SIGTERM) 08:40:44.135002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15655): Terminating (SIGTERM) 08:40:44.177566 --- ParallelTerminationStrategy: PID 15649 died... 08:40:44.197719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15649): Terminated: ok {rc=0} 08:40:44.244506 --- ParallelTerminationStrategy: PID 15652 died... 08:40:44.264110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15652): Terminated: ok {rc=0} 08:40:44.310792 --- ParallelTerminationStrategy: PID 15655 died... 08:40:44.330516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15655): Terminated: ok {rc=0} 08:40:44.419223 bus /gobi_0: Setting Powered False 08:40:45.519210 bus /gobi_0: Setting Powered False 08:40:46.647471 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:40:47.898946 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:47.904741 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:40:47.926006 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:40:47.961169 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:40:48.014550 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:40:48.035369 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:40:48.070392 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:40:48.630784 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:40:48.636755 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:48.648468 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:40:48.709797 tst switch_tch_pdch.py: using LAC 20264 08:40:48.837756 tst switch_tch_pdch.py: using RAC 119 08:40:48.966431 tst switch_tch_pdch.py: using CellId 20264 08:40:49.093426 tst switch_tch_pdch.py: using BVCI 20265 08:40:49.203540 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:49.218018 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:49.229555 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:49.241518 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:49.253320 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:49.265194 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:49.277408 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:40:49.289155 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:40:49.408103 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:40:49.525539 tst switch_tch_pdch.py:51: start network... 08:40:49.728410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:50.172636 run create_hlr_db(pid=15660): Launched 08:40:50.297341 bus /gobi_6: Setting Powered False 08:40:51.357460 run create_hlr_db(pid=15660): Terminated: ok {rc=0} 08:40:51.771117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Launched 08:40:52.094119 run osmo-hlr_10.42.42.2(pid=15663): Launched 08:40:52.217681 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:52.744906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Launched 08:40:53.067348 run osmo-stp_10.42.42.5(pid=15666): Launched 08:40:53.191145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:40:53.720176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Launched 08:40:53.843433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:40:54.115401 run patchelf(pid=15669): Launched 08:40:54.294786 run osmo-stp_10.42.42.5(pid=15666): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] 08:40:54.431681 run osmo-stp_10.42.42.5(pid=15666): stdout: | (launched: 2022-12-09_08:40:53.008683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:54.570040 run osmo-stp_10.42.42.5(pid=15666): stderr: | [0;m[38;5;43m20221209084053198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084053198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084053198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084053199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084053199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084053199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084053199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:54.708368 run osmo-stp_10.42.42.5(pid=15666): stdout: | (launched: 2022-12-09_08:40:53.008683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:54.841208 run osmo-stp_10.42.42.5(pid=15666): stderr: | [0;m[38;5;43m20221209084053198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084053198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084053198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084053199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084053199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084053199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084053199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:54.998518 run patchelf(pid=15669): Terminating (SIGINT) 08:40:55.178659 run patchelf(pid=15669): Terminated: ok {rc=0} 08:40:55.308768 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15666): Process ended prematurely: osmo-stp_10.42.42.5(pid=15666) [trial-2357↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] [trial-2357↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:40:55.318889 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 08:40:55.347710 run osmo-hlr_10.42.42.2(pid=15663): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15663)] 08:40:55.398607 run osmo-hlr_10.42.42.2(pid=15663): stdout: | (launched: 2022-12-09_08:40:52.035528) 08:40:55.451810 run osmo-hlr_10.42.42.2(pid=15663): stderr: | [0;m[1;31m20221209084052231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084052231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084052231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084052231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084052231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084052231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084052244 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084052252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084052252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084052252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:55.505069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Terminating (SIGTERM) 08:40:55.548091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Terminating (SIGTERM) 08:40:55.590963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Terminating (SIGTERM) 08:40:55.633809 --- ParallelTerminationStrategy: PID 15662 died... 08:40:55.653966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15662): Terminated: ok {rc=0} 08:40:55.701554 --- ParallelTerminationStrategy: PID 15665 died... 08:40:55.721764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15665): Terminated: ok {rc=0} 08:40:55.769296 --- ParallelTerminationStrategy: PID 15668 died... 08:40:55.789106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15668): Terminated: ok {rc=0} 08:40:55.877933 bus /gobi_0: Setting Powered False 08:40:56.976327 bus /gobi_0: Setting Powered False 08:40:58.089493 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_sms:trx-b200 --------------------------------------------------------------------- 08:40:59.325116 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:59.328862 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:40:59.362769 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:40:59.369553 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:40:59.422783 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:40:59.456382 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:40:59.463093 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:41:00.003752 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:41:00.008941 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 08:41:00.019807 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 08:41:00.069082 tst mo_mt_sms.py: using LAC 20265 08:41:00.196152 tst mo_mt_sms.py: using RAC 120 08:41:00.322809 tst mo_mt_sms.py: using CellId 20265 08:41:00.449150 tst mo_mt_sms.py: using BVCI 20266 08:41:00.567879 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:41:00.685870 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:41:00.803257 tst mo_mt_sms.py:9: start nitb and bts... 08:41:01.046364 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:41:01.718451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15674): Launched 08:41:02.103680 run osmo-nitb_10.42.42.2(pid=15675): Launched 08:41:02.285908 run osmo-nitb_10.42.42.2(pid=15675): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15675)] 08:41:02.432452 run osmo-nitb_10.42.42.2(pid=15675): stdout: | (launched: 2022-12-09_08:41:02.044599) 08:41:02.580095 run osmo-nitb_10.42.42.2(pid=15675): stderr: | (launched: 2022-12-09_08:41:02.094247) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:41:02.727216 run osmo-nitb_10.42.42.2(pid=15675): stdout: | (launched: 2022-12-09_08:41:02.044599) 08:41:02.868253 run osmo-nitb_10.42.42.2(pid=15675): stderr: | (launched: 2022-12-09_08:41:02.094247) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15675) [trial-2357↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15675)] 08:41:03.228540 tst osmo-nitb_10.42.42.2(pid=15675): stdout: | (launched: 2022-12-09_08:41:02.044599) 08:41:03.359101 tst osmo-nitb_10.42.42.2(pid=15675): stderr: | (launched: 2022-12-09_08:41:02.094247) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:41:03.513095 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15675) [trial-2357↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15675)] [trial-2357↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 08:41:03.522266 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 08:41:03.529689 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15674): Terminating (SIGTERM) 08:41:03.741825 --- ParallelTerminationStrategy: PID 15674 died... 08:41:03.764175 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15674): Terminated: ok {rc=0} 08:41:03.854119 bus /sierra_3: Setting Powered False 08:41:04.955878 bus /sierra_3: Setting Powered False 08:41:06.078517 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:trx-b200 --------------------------------------------------------------------- 08:41:07.279512 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:07.283913 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:41:07.319740 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:41:07.347978 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:41:07.403195 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:41:07.440677 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:41:07.468906 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:41:08.013645 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:41:08.020541 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:08.031895 tst sms:trx-b200: Using 1 x bts (candidates: 1) 08:41:08.081306 tst mo_mt_sms.py: using LAC 20266 08:41:08.202978 tst mo_mt_sms.py: using RAC 121 08:41:08.324307 tst mo_mt_sms.py: using CellId 20266 08:41:08.443285 tst mo_mt_sms.py: using BVCI 20267 08:41:08.554506 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:08.565321 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:08.575911 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:08.586669 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:08.597199 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:08.607610 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:41:08.724496 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:41:08.845459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:09.349896 run create_hlr_db(pid=15679): Launched 08:41:09.474559 bus /sierra_2: Setting Powered False 08:41:10.538797 run create_hlr_db(pid=15679): Terminated: ok {rc=0} 08:41:10.971762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15681): Launched 08:41:11.277385 run osmo-hlr_10.42.42.2(pid=15682): Launched 08:41:11.393675 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:11.930451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15684): Launched 08:41:12.234399 run osmo-stp_10.42.42.5(pid=15685): Launched 08:41:12.351323 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:12.897444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15687): Launched 08:41:13.198825 run osmo-msc_10.42.42.6(pid=15688): Launched 08:41:13.368798 run osmo-stp_10.42.42.5(pid=15685): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15685)] 08:41:13.496678 run osmo-stp_10.42.42.5(pid=15685): stdout: | (launched: 2022-12-09_08:41:12.178882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:13.624295 run osmo-stp_10.42.42.5(pid=15685): stderr: | [0;m[38;5;43m20221209084112348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084112348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084112349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084112349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084112350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084112350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084112350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:13.750032 run osmo-stp_10.42.42.5(pid=15685): stdout: | (launched: 2022-12-09_08:41:12.178882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:13.869836 run osmo-stp_10.42.42.5(pid=15685): stderr: | [0;m[38;5;43m20221209084112348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084112348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084112349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084112349 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084112350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084112350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084112350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:14.013256 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15685): Process ended prematurely: osmo-stp_10.42.42.5(pid=15685) [trial-2357↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15685)] [trial-2357↪sms:trx-b200↪mo_mt_sms.py:16] 08:41:14.021476 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 08:41:14.047509 run osmo-hlr_10.42.42.2(pid=15682): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15682)] 08:41:14.096510 run osmo-hlr_10.42.42.2(pid=15682): stdout: | (launched: 2022-12-09_08:41:11.220843) 08:41:14.146278 run osmo-hlr_10.42.42.2(pid=15682): stderr: | [0;m[1;31m20221209084111394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084111394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084111394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084111394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084111394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084111394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084111407 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084111415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084111415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084111415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:14.216038 run osmo-msc_10.42.42.6(pid=15688): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15688)] 08:41:14.264322 run osmo-msc_10.42.42.6(pid=15688): stdout: | (launched: 2022-12-09_08:41:13.143604) 08:41:14.314002 run osmo-msc_10.42.42.6(pid=15688): stderr: | [0;m[38;5;43m20221209084113415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084113415 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fead7071c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084113415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084113415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084113416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084113416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084113418 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084113418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084113418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084113418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:14.364113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15681): Terminating (SIGTERM) 08:41:14.404072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15684): Terminating (SIGTERM) 08:41:14.444317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15687): Terminating (SIGTERM) 08:41:14.484705 --- ParallelTerminationStrategy: PID 15681 died... 08:41:14.504041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15681): Terminated: ok {rc=0} 08:41:14.548412 --- ParallelTerminationStrategy: PID 15684 died... 08:41:14.567200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15684): Terminated: ok {rc=0} 08:41:14.611501 --- ParallelTerminationStrategy: PID 15687 died... 08:41:14.630373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15687): Terminated: ok {rc=0} 08:41:14.717124 bus /sierra_3: Setting Powered False 08:41:15.817101 bus /sierra_3: Setting Powered False 08:41:16.943870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-b200 --------------------------------------------------------------------- 08:41:18.185624 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:18.189681 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:41:18.223762 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:41:18.230535 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:41:18.265113 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:41:18.299334 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:41:18.306262 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:41:18.825910 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:41:18.830925 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 08:41:18.841985 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 08:41:18.891597 tst assert_extension.py: using LAC 20267 08:41:19.010306 tst assert_extension.py: using RAC 122 08:41:19.137274 tst assert_extension.py: using CellId 20267 08:41:19.267927 tst assert_extension.py: using BVCI 20268 08:41:19.387222 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 08:41:19.504714 tst assert_extension.py:10: start nitb and bts... 08:41:19.707332 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:41:20.325053 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15694): Launched 08:41:20.626500 run osmo-nitb_10.42.42.2(pid=15695): Launched 08:41:20.793502 run osmo-nitb_10.42.42.2(pid=15695): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15695)] 08:41:20.928500 run osmo-nitb_10.42.42.2(pid=15695): stdout: | (launched: 2022-12-09_08:41:20.571303) 08:41:21.065277 run osmo-nitb_10.42.42.2(pid=15695): stderr: | (launched: 2022-12-09_08:41:20.616328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:41:21.202030 run osmo-nitb_10.42.42.2(pid=15695): stdout: | (launched: 2022-12-09_08:41:20.571303) 08:41:21.333649 run osmo-nitb_10.42.42.2(pid=15695): stderr: | (launched: 2022-12-09_08:41:20.616328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15695): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15695) [trial-2357↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15695)] 08:41:21.740230 tst osmo-nitb_10.42.42.2(pid=15695): stdout: | (launched: 2022-12-09_08:41:20.571303) 08:41:21.861918 tst osmo-nitb_10.42.42.2(pid=15695): stderr: | (launched: 2022-12-09_08:41:20.616328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:41:22.005057 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15695): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15695) [trial-2357↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15695)] [trial-2357↪nitb_ussd:trx-b200↪assert_extension.py:12] 08:41:22.013445 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:41:22.019936 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15694): Terminating (SIGTERM) 08:41:22.229067 --- ParallelTerminationStrategy: PID 15694 died... 08:41:22.249621 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15694): Terminated: ok {rc=0} 08:41:22.335962 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:trx-b200 --------------------------------------------------------------------- 08:41:23.518487 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:23.522540 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:41:23.556398 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:41:23.583913 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:41:23.621259 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:41:23.656686 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:41:23.685484 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:41:24.209908 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:41:24.214941 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:24.225918 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 08:41:24.273299 tst assert_extension.py: using LAC 20268 08:41:24.394174 tst assert_extension.py: using RAC 123 08:41:24.512685 tst assert_extension.py: using CellId 20268 08:41:24.631112 tst assert_extension.py: using BVCI 20269 08:41:24.742290 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:24.752996 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:24.763586 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:24.774102 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:24.784646 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:41:24.795211 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 08:41:24.914012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:25.417329 run create_hlr_db(pid=15699): Launched 08:41:25.542963 bus /sierra_2: Setting Powered False 08:41:26.606868 run create_hlr_db(pid=15699): Terminated: ok {rc=0} 08:41:27.039797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15701): Launched 08:41:27.341600 run osmo-hlr_10.42.42.2(pid=15702): Launched 08:41:27.458001 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:27.982251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15704): Launched 08:41:28.284244 run osmo-stp_10.42.42.5(pid=15705): Launched 08:41:28.399818 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:28.945559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15707): Launched 08:41:29.246609 run osmo-msc_10.42.42.6(pid=15708): Launched 08:41:29.416438 run osmo-stp_10.42.42.5(pid=15705): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15705)] 08:41:29.543781 run osmo-stp_10.42.42.5(pid=15705): stdout: | (launched: 2022-12-09_08:41:28.228550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:29.671958 run osmo-stp_10.42.42.5(pid=15705): stderr: | [0;m[38;5;43m20221209084128396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084128396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084128396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084128397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084128397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084128397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084128397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:29.797896 run osmo-stp_10.42.42.5(pid=15705): stdout: | (launched: 2022-12-09_08:41:28.228550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:29.918436 run osmo-stp_10.42.42.5(pid=15705): stderr: | [0;m[38;5;43m20221209084128396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084128396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084128396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084128397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084128397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084128397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084128397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:30.062390 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15705): Process ended prematurely: osmo-stp_10.42.42.5(pid=15705) [trial-2357↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15705)] [trial-2357↪ussd:trx-b200↪assert_extension.py:17] 08:41:30.070868 tst assert_extension.py:17: Test FAILED (5.8 sec) 08:41:30.097264 run osmo-hlr_10.42.42.2(pid=15702): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15702)] 08:41:30.145531 run osmo-hlr_10.42.42.2(pid=15702): stdout: | (launched: 2022-12-09_08:41:27.286290) 08:41:30.195674 run osmo-hlr_10.42.42.2(pid=15702): stderr: | [0;m[1;31m20221209084127458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084127458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084127458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084127458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084127458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084127458 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084127470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084127480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084127480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084127480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:30.265435 run osmo-msc_10.42.42.6(pid=15708): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15708)] 08:41:30.313600 run osmo-msc_10.42.42.6(pid=15708): stdout: | (launched: 2022-12-09_08:41:29.191085) 08:41:30.363413 run osmo-msc_10.42.42.6(pid=15708): stderr: | [0;m[38;5;43m20221209084129460 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084129460 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb254cf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084129461 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084129461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084129461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084129461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084129463 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084129463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084129463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084129463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:30.413772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15701): Terminating (SIGTERM) 08:41:30.453997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15704): Terminating (SIGTERM) 08:41:30.494429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15707): Terminating (SIGTERM) 08:41:30.534769 --- ParallelTerminationStrategy: PID 15701 died... 08:41:30.554128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15701): Terminated: ok {rc=0} 08:41:30.598515 --- ParallelTerminationStrategy: PID 15704 died... 08:41:30.617237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15704): Terminated: ok {rc=0} 08:41:30.661136 --- ParallelTerminationStrategy: PID 15707 died... 08:41:30.679883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15707): Terminated: ok {rc=0} 08:41:30.765903 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:41:32.010995 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:32.020502 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:41:32.062314 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:41:32.096577 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:41:32.152799 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:41:32.191342 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:41:32.224538 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:41:32.766020 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:41:32.815821 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:32.827102 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:41:32.895675 tst mo_mt_call.py: using LAC 20269 08:41:33.024934 tst mo_mt_call.py: using RAC 124 08:41:33.151329 tst mo_mt_call.py: using CellId 20269 08:41:33.278354 tst mo_mt_call.py: using BVCI 20270 08:41:33.399580 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:33.411424 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:33.423153 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:33.435138 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:33.447168 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:33.458982 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:41:33.582691 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:41:33.702129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:34.182927 run create_hlr_db(pid=15713): Launched 08:41:34.308752 bus /sierra_2: Setting Powered False 08:41:35.370497 run create_hlr_db(pid=15713): Terminated: ok {rc=0} 08:41:35.820436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15715): Launched 08:41:36.149497 run osmo-hlr_10.42.42.2(pid=15716): Launched 08:41:36.274965 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:36.845598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15718): Launched 08:41:37.174555 run osmo-stp_10.42.42.5(pid=15719): Launched 08:41:37.301585 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:37.897540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15721): Launched 08:41:38.226067 run osmo-msc_10.42.42.6(pid=15722): Launched 08:41:38.410692 run osmo-stp_10.42.42.5(pid=15719): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15719)] 08:41:38.550431 run osmo-stp_10.42.42.5(pid=15719): stdout: | (launched: 2022-12-09_08:41:37.115059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:38.690126 run osmo-stp_10.42.42.5(pid=15719): stderr: | [0;m[38;5;43m20221209084137304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084137304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084137304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084137305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084137305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084137305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084137306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:38.829106 run osmo-stp_10.42.42.5(pid=15719): stdout: | (launched: 2022-12-09_08:41:37.115059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:38.961284 run osmo-stp_10.42.42.5(pid=15719): stderr: | [0;m[38;5;43m20221209084137304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084137304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084137304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084137305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084137305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084137305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084137306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:39.119228 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15719): Process ended prematurely: osmo-stp_10.42.42.5(pid=15719) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15719)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:41:39.128898 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:41:39.157088 run osmo-hlr_10.42.42.2(pid=15716): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15716)] 08:41:39.208312 run osmo-hlr_10.42.42.2(pid=15716): stdout: | (launched: 2022-12-09_08:41:36.089938) 08:41:39.261079 run osmo-hlr_10.42.42.2(pid=15716): stderr: | [0;m[1;31m20221209084136287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084136287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084136287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084136287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084136287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084136287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084136300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084136309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084136309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084136309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:39.334069 run osmo-msc_10.42.42.6(pid=15722): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15722)] 08:41:39.385058 run osmo-msc_10.42.42.6(pid=15722): stdout: | (launched: 2022-12-09_08:41:38.166575) 08:41:39.437245 run osmo-msc_10.42.42.6(pid=15722): stderr: | [0;m[38;5;43m20221209084138485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084138485 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07f52f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084138485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084138485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084138485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084138486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084138487 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084138488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084138488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084138488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:39.490638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15715): Terminating (SIGTERM) 08:41:39.533056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15718): Terminating (SIGTERM) 08:41:39.575245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15721): Terminating (SIGTERM) 08:41:39.617732 --- ParallelTerminationStrategy: PID 15715 died... 08:41:39.637775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15715): Terminated: ok {rc=0} 08:41:39.684757 --- ParallelTerminationStrategy: PID 15718 died... 08:41:39.704604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15718): Terminated: ok {rc=0} 08:41:39.752797 --- ParallelTerminationStrategy: PID 15721 died... 08:41:39.773045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15721): Terminated: ok {rc=0} 08:41:39.863351 bus /sierra_3: Setting Powered False 08:41:40.965293 bus /sierra_3: Setting Powered False 08:41:42.082999 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:41:43.235328 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:43.247869 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:41:43.323998 tst mo_mt_call_osmux.py: using LAC 20270 08:41:43.452549 tst mo_mt_call_osmux.py: using RAC 125 08:41:43.580083 tst mo_mt_call_osmux.py: using CellId 20270 08:41:43.707314 tst mo_mt_call_osmux.py: using BVCI 20271 08:41:43.827558 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:43.839257 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:43.850777 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:43.862783 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:43.874693 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:41:43.886457 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:41:44.004035 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:41:44.126010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:44.636226 run create_hlr_db(pid=15724): Launched 08:41:44.762177 bus /sierra_2: Setting Powered False 08:41:45.826947 run create_hlr_db(pid=15724): Terminated: ok {rc=0} 08:41:46.313140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15726): Launched 08:41:46.644526 run osmo-hlr_10.42.42.2(pid=15727): Launched 08:41:46.890647 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:47.569810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15729): Launched 08:41:47.898881 run osmo-stp_10.42.42.5(pid=15730): Launched 08:41:48.024194 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:48.616913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15732): Launched 08:41:48.945227 run osmo-msc_10.42.42.6(pid=15733): Launched 08:41:49.130681 run osmo-stp_10.42.42.5(pid=15730): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15730)] 08:41:49.269314 run osmo-stp_10.42.42.5(pid=15730): stdout: | (launched: 2022-12-09_08:41:47.839010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:49.408209 run osmo-stp_10.42.42.5(pid=15730): stderr: | [0;m[38;5;43m20221209084148029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084148029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084148029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084148030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084148030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084148030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084148030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:49.546003 run osmo-stp_10.42.42.5(pid=15730): stdout: | (launched: 2022-12-09_08:41:47.839010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:49.677805 run osmo-stp_10.42.42.5(pid=15730): stderr: | [0;m[38;5;43m20221209084148029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084148029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084148029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084148030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084148030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084148030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084148030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:49.835622 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15730): Process ended prematurely: osmo-stp_10.42.42.5(pid=15730) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15730)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:41:49.845616 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:41:49.873661 run osmo-hlr_10.42.42.2(pid=15727): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15727)] 08:41:49.924115 run osmo-hlr_10.42.42.2(pid=15727): stdout: | (launched: 2022-12-09_08:41:46.586465) 08:41:49.976375 run osmo-hlr_10.42.42.2(pid=15727): stderr: | [0;m[1;31m20221209084146936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084146936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084146936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084146936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084146936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084146936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084146959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084146979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084146980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084146980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:50.048601 run osmo-msc_10.42.42.6(pid=15733): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15733)] 08:41:50.098778 run osmo-msc_10.42.42.6(pid=15733): stdout: | (launched: 2022-12-09_08:41:48.885705) 08:41:50.150518 run osmo-msc_10.42.42.6(pid=15733): stderr: | [0;m[38;5;43m20221209084149206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084149206 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f859bfc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084149206 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084149206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084149206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084149207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084149208 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084149209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084149209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084149209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:50.202929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15726): Terminating (SIGTERM) 08:41:50.245121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15729): Terminating (SIGTERM) 08:41:50.287170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15732): Terminating (SIGTERM) 08:41:50.330096 --- ParallelTerminationStrategy: PID 15726 died... 08:41:50.350455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15726): Terminated: ok {rc=0} 08:41:50.397041 --- ParallelTerminationStrategy: PID 15729 died... 08:41:50.416677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15729): Terminated: ok {rc=0} 08:41:50.463313 --- ParallelTerminationStrategy: PID 15732 died... 08:41:50.482908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15732): Terminated: ok {rc=0} 08:41:50.571474 bus /sierra_3: Setting Powered False 08:41:51.671101 bus /sierra_3: Setting Powered False 08:41:52.791175 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:41:54.045459 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:54.052312 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:41:54.086700 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:41:54.113956 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:41:54.167699 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:41:54.201532 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:41:54.228701 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:41:54.779222 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:41:54.828855 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:41:54.840321 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:41:54.910777 tst mo_mt_call.py: using LAC 20271 08:41:55.033363 tst mo_mt_call.py: using RAC 126 08:41:55.155322 tst mo_mt_call.py: using CellId 20271 08:41:55.277482 tst mo_mt_call.py: using BVCI 20272 08:41:55.391134 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:41:55.402655 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:41:55.414098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:41:55.425629 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:41:55.436839 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:41:55.448079 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:41:55.567906 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:41:55.688597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:56.168113 run create_hlr_db(pid=15738): Launched 08:41:56.293924 bus /sierra_2: Setting Powered False 08:41:57.354259 run create_hlr_db(pid=15738): Terminated: ok {rc=0} 08:41:57.805984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15740): Launched 08:41:58.135781 run osmo-hlr_10.42.42.2(pid=15741): Launched 08:41:58.261794 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:58.831139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15743): Launched 08:41:59.161456 run osmo-stp_10.42.42.5(pid=15744): Launched 08:41:59.288336 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:59.885962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15746): Launched 08:42:00.214419 run osmo-msc_10.42.42.6(pid=15747): Launched 08:42:00.400042 run osmo-stp_10.42.42.5(pid=15744): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15744)] 08:42:00.539527 run osmo-stp_10.42.42.5(pid=15744): stdout: | (launched: 2022-12-09_08:41:59.101827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:00.678977 run osmo-stp_10.42.42.5(pid=15744): stderr: | [0;m[38;5;43m20221209084159292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084159292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084159292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084159292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084159293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084159293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084159293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:00.817278 run osmo-stp_10.42.42.5(pid=15744): stdout: | (launched: 2022-12-09_08:41:59.101827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:00.986206 run osmo-stp_10.42.42.5(pid=15744): stderr: | [0;m[38;5;43m20221209084159292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084159292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084159292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084159292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084159293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084159293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084159293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:01.168098 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15744): Process ended prematurely: osmo-stp_10.42.42.5(pid=15744) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15744)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:42:01.178421 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:42:01.208324 run osmo-hlr_10.42.42.2(pid=15741): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15741)] 08:42:01.259387 run osmo-hlr_10.42.42.2(pid=15741): stdout: | (launched: 2022-12-09_08:41:58.075757) 08:42:01.311004 run osmo-hlr_10.42.42.2(pid=15741): stderr: | [0;m[1;31m20221209084158272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084158272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084158272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084158272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084158272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084158272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084158284 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084158293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084158293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084158294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:01.382459 run osmo-msc_10.42.42.6(pid=15747): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15747)] 08:42:01.433311 run osmo-msc_10.42.42.6(pid=15747): stdout: | (launched: 2022-12-09_08:42:00.154977) 08:42:01.485179 run osmo-msc_10.42.42.6(pid=15747): stderr: | [0;m[38;5;43m20221209084200474 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084200474 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f348c053c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084200474 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084200474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084200474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084200474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084200476 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084200477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084200477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084200477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:01.536895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15740): Terminating (SIGTERM) 08:42:01.578886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15743): Terminating (SIGTERM) 08:42:01.623917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15746): Terminating (SIGTERM) 08:42:01.668473 --- ParallelTerminationStrategy: PID 15740 died... 08:42:01.688187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15740): Terminated: ok {rc=0} 08:42:01.735093 --- ParallelTerminationStrategy: PID 15743 died... 08:42:01.754630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15743): Terminated: ok {rc=0} 08:42:01.800295 --- ParallelTerminationStrategy: PID 15746 died... 08:42:01.820684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15746): Terminated: ok {rc=0} 08:42:01.909439 bus /sierra_3: Setting Powered False 08:42:03.008817 bus /sierra_3: Setting Powered False 08:42:04.128829 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:42:05.277469 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:42:05.289570 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:42:05.363348 tst mo_mt_call_osmux.py: using LAC 20272 08:42:05.483688 tst mo_mt_call_osmux.py: using RAC 127 08:42:05.611444 tst mo_mt_call_osmux.py: using CellId 20272 08:42:05.739626 tst mo_mt_call_osmux.py: using BVCI 20273 08:42:05.859665 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:42:05.871606 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:42:05.883337 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:42:05.895719 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:42:05.907906 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:42:05.920135 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:42:06.039568 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:42:06.162781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:06.675449 run create_hlr_db(pid=15754): Launched 08:42:06.800841 bus /sierra_2: Setting Powered False 08:42:07.865654 run create_hlr_db(pid=15754): Terminated: ok {rc=0} 08:42:08.307231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15756): Launched 08:42:08.617208 run osmo-hlr_10.42.42.2(pid=15757): Launched 08:42:08.738067 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:09.268496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15759): Launched 08:42:09.577011 run osmo-stp_10.42.42.5(pid=15760): Launched 08:42:09.695953 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:10.259960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15762): Launched 08:42:10.568862 run osmo-msc_10.42.42.6(pid=15763): Launched 08:42:10.743810 run osmo-stp_10.42.42.5(pid=15760): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15760)] 08:42:10.874054 run osmo-stp_10.42.42.5(pid=15760): stdout: | (launched: 2022-12-09_08:42:09.520581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:11.004212 run osmo-stp_10.42.42.5(pid=15760): stderr: | [0;m[38;5;43m20221209084209692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084209692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084209692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084209693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084209693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084209693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084209693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:11.133053 run osmo-stp_10.42.42.5(pid=15760): stdout: | (launched: 2022-12-09_08:42:09.520581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:11.255901 run osmo-stp_10.42.42.5(pid=15760): stderr: | [0;m[38;5;43m20221209084209692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084209692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084209692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084209693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084209693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084209693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084209693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:11.403035 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15760): Process ended prematurely: osmo-stp_10.42.42.5(pid=15760) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15760)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:42:11.412442 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:42:11.439066 run osmo-hlr_10.42.42.2(pid=15757): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15757)] 08:42:11.486984 run osmo-hlr_10.42.42.2(pid=15757): stdout: | (launched: 2022-12-09_08:42:08.560501) 08:42:11.536562 run osmo-hlr_10.42.42.2(pid=15757): stderr: | [0;m[1;31m20221209084208734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084208734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084208734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084208734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084208734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084208734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084208749 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084208758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084208758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084208758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:11.605892 run osmo-msc_10.42.42.6(pid=15763): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15763)] 08:42:11.653698 run osmo-msc_10.42.42.6(pid=15763): stdout: | (launched: 2022-12-09_08:42:10.512515) 08:42:11.703198 run osmo-msc_10.42.42.6(pid=15763): stderr: | [0;m[38;5;43m20221209084210785 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084210785 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5379e84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084210785 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084210785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084210785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084210785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084210787 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084210787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084210788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084210788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:11.753944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15756): Terminating (SIGTERM) 08:42:11.793954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15759): Terminating (SIGTERM) 08:42:11.833644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15762): Terminating (SIGTERM) 08:42:11.873666 --- ParallelTerminationStrategy: PID 15756 died... 08:42:11.893066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15756): Terminated: ok {rc=0} 08:42:11.937065 --- ParallelTerminationStrategy: PID 15759 died... 08:42:11.955731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15759): Terminated: ok {rc=0} 08:42:11.999452 --- ParallelTerminationStrategy: PID 15762 died... 08:42:12.018137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15762): Terminated: ok {rc=0} 08:42:12.101769 bus /sierra_3: Setting Powered False 08:42:13.199801 bus /sierra_3: Setting Powered False 08:42:14.316563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:42:15.571881 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:15.579269 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:42:15.616263 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:42:15.644261 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:42:15.698968 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:42:15.733928 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:42:15.762524 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:42:16.337659 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:42:16.398680 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:16.412162 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:42:16.487142 tst mo_mt_call.py: using LAC 20273 08:42:16.635403 tst mo_mt_call.py: using RAC 128 08:42:16.769432 tst mo_mt_call.py: using CellId 20273 08:42:16.926226 tst mo_mt_call.py: using BVCI 20274 08:42:17.042089 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:17.054121 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:17.066285 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:17.078596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:17.090940 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:17.103175 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:42:17.232887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:42:17.352798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:17.834788 run create_hlr_db(pid=15768): Launched 08:42:17.962005 bus /sierra_2: Setting Powered False 08:42:19.023293 run create_hlr_db(pid=15768): Terminated: ok {rc=0} 08:42:19.473661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15770): Launched 08:42:19.803613 run osmo-hlr_10.42.42.2(pid=15771): Launched 08:42:19.929832 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:20.496039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15773): Launched 08:42:20.825904 run osmo-stp_10.42.42.5(pid=15774): Launched 08:42:20.951756 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:21.549235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15776): Launched 08:42:21.879918 run osmo-msc_10.42.42.6(pid=15777): Launched 08:42:22.063852 run osmo-stp_10.42.42.5(pid=15774): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15774)] 08:42:22.202624 run osmo-stp_10.42.42.5(pid=15774): stdout: | (launched: 2022-12-09_08:42:20.765653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:22.342012 run osmo-stp_10.42.42.5(pid=15774): stderr: | [0;m[38;5;43m20221209084220955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084220955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084220955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084220955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084220956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084220956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084220956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:22.479366 run osmo-stp_10.42.42.5(pid=15774): stdout: | (launched: 2022-12-09_08:42:20.765653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:22.611351 run osmo-stp_10.42.42.5(pid=15774): stderr: | [0;m[38;5;43m20221209084220955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084220955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084220955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084220955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084220956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084220956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084220956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:22.769595 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15774): Process ended prematurely: osmo-stp_10.42.42.5(pid=15774) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15774)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:42:22.779142 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:42:22.807474 run osmo-hlr_10.42.42.2(pid=15771): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15771)] 08:42:22.857822 run osmo-hlr_10.42.42.2(pid=15771): stdout: | (launched: 2022-12-09_08:42:19.743488) 08:42:22.909922 run osmo-hlr_10.42.42.2(pid=15771): stderr: | [0;m[1;31m20221209084219940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084219940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084219940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084219940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084219940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084219940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084219982 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084219992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084219992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084219992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:22.982196 run osmo-msc_10.42.42.6(pid=15777): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15777)] 08:42:23.032463 run osmo-msc_10.42.42.6(pid=15777): stdout: | (launched: 2022-12-09_08:42:21.820176) 08:42:23.084466 run osmo-msc_10.42.42.6(pid=15777): stderr: | [0;m[38;5;43m20221209084222141 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084222141 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f2618ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084222141 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084222141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084222141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084222142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084222143 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084222144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084222144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084222144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:23.137106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15770): Terminating (SIGTERM) 08:42:23.179023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15773): Terminating (SIGTERM) 08:42:23.221148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15776): Terminating (SIGTERM) 08:42:23.263432 --- ParallelTerminationStrategy: PID 15770 died... 08:42:23.283393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15770): Terminated: ok {rc=0} 08:42:23.330308 --- ParallelTerminationStrategy: PID 15773 died... 08:42:23.349985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15773): Terminated: ok {rc=0} 08:42:23.397147 --- ParallelTerminationStrategy: PID 15776 died... 08:42:23.416692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15776): Terminated: ok {rc=0} 08:42:23.506025 bus /sierra_3: Setting Powered False 08:42:24.605365 bus /sierra_3: Setting Powered False 08:42:25.721439 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:42:26.873677 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:26.886021 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:42:26.958435 tst mo_mt_call_osmux.py: using LAC 20274 08:42:27.087112 tst mo_mt_call_osmux.py: using RAC 129 08:42:27.217376 tst mo_mt_call_osmux.py: using CellId 20274 08:42:27.347330 tst mo_mt_call_osmux.py: using BVCI 20275 08:42:27.469044 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:27.480786 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:27.493884 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:27.506246 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:27.517964 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:42:27.529877 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:42:27.652477 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:42:27.773161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:28.287619 run create_hlr_db(pid=15779): Launched 08:42:28.413224 bus /sierra_2: Setting Powered False 08:42:29.478196 run create_hlr_db(pid=15779): Terminated: ok {rc=0} 08:42:29.920239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15781): Launched 08:42:30.229701 run osmo-hlr_10.42.42.2(pid=15782): Launched 08:42:30.348354 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:30.885740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15784): Launched 08:42:31.241173 run osmo-stp_10.42.42.5(pid=15785): Launched 08:42:31.480265 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:32.145720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15787): Launched 08:42:32.470339 run osmo-msc_10.42.42.6(pid=15788): Launched 08:42:32.643191 run osmo-stp_10.42.42.5(pid=15785): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15785)] 08:42:32.773762 run osmo-stp_10.42.42.5(pid=15785): stdout: | (launched: 2022-12-09_08:42:31.179115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:32.904201 run osmo-stp_10.42.42.5(pid=15785): stderr: | [0;m[38;5;43m20221209084231448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084231448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084231448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084231449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084231449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084231449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084231449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:33.033628 run osmo-stp_10.42.42.5(pid=15785): stdout: | (launched: 2022-12-09_08:42:31.179115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:33.157513 run osmo-stp_10.42.42.5(pid=15785): stderr: | [0;m[38;5;43m20221209084231448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084231448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084231448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084231449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084231449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084231449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084231449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:33.305935 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15785): Process ended prematurely: osmo-stp_10.42.42.5(pid=15785) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15785)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:42:33.314969 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:42:33.341765 run osmo-hlr_10.42.42.2(pid=15782): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15782)] 08:42:33.390327 run osmo-hlr_10.42.42.2(pid=15782): stdout: | (launched: 2022-12-09_08:42:30.173420) 08:42:33.440196 run osmo-hlr_10.42.42.2(pid=15782): stderr: | [0;m[1;31m20221209084230347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084230347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084230347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084230348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084230348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084230348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084230360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084230368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084230368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084230368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:33.510018 run osmo-msc_10.42.42.6(pid=15788): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15788)] 08:42:33.558319 run osmo-msc_10.42.42.6(pid=15788): stdout: | (launched: 2022-12-09_08:42:32.412893) 08:42:33.608091 run osmo-msc_10.42.42.6(pid=15788): stderr: | [0;m[38;5;43m20221209084232685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084232686 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbfcdd25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084232686 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084232686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084232686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084232686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084232688 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084232688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084232688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084232688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:33.658345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15781): Terminating (SIGTERM) 08:42:33.698675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15784): Terminating (SIGTERM) 08:42:33.739081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15787): Terminating (SIGTERM) 08:42:33.779381 --- ParallelTerminationStrategy: PID 15781 died... 08:42:33.798582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15781): Terminated: ok {rc=0} 08:42:33.842918 --- ParallelTerminationStrategy: PID 15784 died... 08:42:33.861655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15784): Terminated: ok {rc=0} 08:42:33.905927 --- ParallelTerminationStrategy: PID 15787 died... 08:42:33.924882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15787): Terminated: ok {rc=0} 08:42:34.008984 bus /sierra_3: Setting Powered False 08:42:35.107841 bus /sierra_3: Setting Powered False 08:42:36.225982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:42:37.483599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:37.490977 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:42:37.524538 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:42:37.551983 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:42:37.604768 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:42:37.638568 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:42:37.665500 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:42:38.218261 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:42:38.267439 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:38.278757 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:42:38.353566 tst mo_mt_call.py: using LAC 20275 08:42:38.482501 tst mo_mt_call.py: using RAC 130 08:42:38.611890 tst mo_mt_call.py: using CellId 20275 08:42:38.731590 tst mo_mt_call.py: using BVCI 20276 08:42:38.845325 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:38.856511 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:38.867733 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:38.878817 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:38.890038 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:38.901161 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:42:39.020567 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:42:39.141188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:39.655127 run create_hlr_db(pid=15794): Launched 08:42:39.782245 bus /sierra_2: Setting Powered False 08:42:40.847734 run create_hlr_db(pid=15794): Terminated: ok {rc=0} 08:42:41.306435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15796): Launched 08:42:41.638660 run osmo-hlr_10.42.42.2(pid=15797): Launched 08:42:41.766530 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:42.335277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15799): Launched 08:42:42.665843 run osmo-stp_10.42.42.5(pid=15800): Launched 08:42:42.796142 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:43.398913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15802): Launched 08:42:43.713717 run osmo-msc_10.42.42.6(pid=15803): Launched 08:42:43.887132 run osmo-stp_10.42.42.5(pid=15800): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15800)] 08:42:44.018123 run osmo-stp_10.42.42.5(pid=15800): stdout: | (launched: 2022-12-09_08:42:42.606053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:44.148591 run osmo-stp_10.42.42.5(pid=15800): stderr: | [0;m[38;5;43m20221209084242794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084242794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084242795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084242795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084242796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084242796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084242796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:44.277639 run osmo-stp_10.42.42.5(pid=15800): stdout: | (launched: 2022-12-09_08:42:42.606053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:44.403499 run osmo-stp_10.42.42.5(pid=15800): stderr: | [0;m[38;5;43m20221209084242794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084242794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084242795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084242795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084242796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084242796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084242796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:44.551570 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15800): Process ended prematurely: osmo-stp_10.42.42.5(pid=15800) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15800)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:42:44.560501 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:42:44.586895 run osmo-hlr_10.42.42.2(pid=15797): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15797)] 08:42:44.634776 run osmo-hlr_10.42.42.2(pid=15797): stdout: | (launched: 2022-12-09_08:42:41.578846) 08:42:44.684070 run osmo-hlr_10.42.42.2(pid=15797): stderr: | [0;m[1;31m20221209084241774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084241774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084241774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084241774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084241774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084241775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084241787 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084241795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084241796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084241796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:44.753016 run osmo-msc_10.42.42.6(pid=15803): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15803)] 08:42:44.801215 run osmo-msc_10.42.42.6(pid=15803): stdout: | (launched: 2022-12-09_08:42:43.657122) 08:42:44.850677 run osmo-msc_10.42.42.6(pid=15803): stderr: | [0;m[38;5;43m20221209084243928 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084243928 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5a02dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084243929 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084243929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084243929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084243929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084243931 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084243931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084243931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084243931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:44.900410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15796): Terminating (SIGTERM) 08:42:44.940000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15799): Terminating (SIGTERM) 08:42:44.979521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15802): Terminating (SIGTERM) 08:42:45.019348 --- ParallelTerminationStrategy: PID 15796 died... 08:42:45.038379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15796): Terminated: ok {rc=0} 08:42:45.082143 --- ParallelTerminationStrategy: PID 15799 died... 08:42:45.100750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15799): Terminated: ok {rc=0} 08:42:45.145102 --- ParallelTerminationStrategy: PID 15802 died... 08:42:45.163749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15802): Terminated: ok {rc=0} 08:42:45.250752 bus /sierra_3: Setting Powered False 08:42:46.351440 bus /sierra_3: Setting Powered False 08:42:47.472282 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:42:48.623230 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:48.635562 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:42:48.707804 tst mo_mt_call_osmux.py: using LAC 20276 08:42:48.837158 tst mo_mt_call_osmux.py: using RAC 131 08:42:48.965392 tst mo_mt_call_osmux.py: using CellId 20276 08:42:49.093910 tst mo_mt_call_osmux.py: using BVCI 20277 08:42:49.213578 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:49.225435 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:49.237042 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:49.248763 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:49.260678 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:42:49.272448 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:42:49.391164 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:42:49.512812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:50.025554 run create_hlr_db(pid=15805): Launched 08:42:50.151877 bus /sierra_2: Setting Powered False 08:42:51.217440 run create_hlr_db(pid=15805): Terminated: ok {rc=0} 08:42:51.657626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15807): Launched 08:42:51.997911 run osmo-hlr_10.42.42.2(pid=15808): Launched 08:42:52.126368 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:52.696202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15810): Launched 08:42:53.026645 run osmo-stp_10.42.42.5(pid=15811): Launched 08:42:53.152641 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:53.749665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15813): Launched 08:42:54.081369 run osmo-msc_10.42.42.6(pid=15814): Launched 08:42:54.265542 run osmo-stp_10.42.42.5(pid=15811): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15811)] 08:42:54.405310 run osmo-stp_10.42.42.5(pid=15811): stdout: | (launched: 2022-12-09_08:42:52.967041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:54.545297 run osmo-stp_10.42.42.5(pid=15811): stderr: | [0;m[38;5;43m20221209084253155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084253155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084253155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084253156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084253156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084253156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084253157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:54.683095 run osmo-stp_10.42.42.5(pid=15811): stdout: | (launched: 2022-12-09_08:42:52.967041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:54.815523 run osmo-stp_10.42.42.5(pid=15811): stderr: | [0;m[38;5;43m20221209084253155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084253155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084253155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084253156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084253156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084253156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084253157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:54.973581 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15811): Process ended prematurely: osmo-stp_10.42.42.5(pid=15811) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15811)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:42:54.983207 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:42:55.011751 run osmo-hlr_10.42.42.2(pid=15808): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15808)] 08:42:55.062339 run osmo-hlr_10.42.42.2(pid=15808): stdout: | (launched: 2022-12-09_08:42:51.938522) 08:42:55.114779 run osmo-hlr_10.42.42.2(pid=15808): stderr: | [0;m[1;31m20221209084252133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084252133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084252133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084252133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084252133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084252134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084252146 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084252156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084252156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084252157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:55.187692 run osmo-msc_10.42.42.6(pid=15814): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15814)] 08:42:55.238278 run osmo-msc_10.42.42.6(pid=15814): stdout: | (launched: 2022-12-09_08:42:54.021301) 08:42:55.290314 run osmo-msc_10.42.42.6(pid=15814): stderr: | [0;m[38;5;43m20221209084254340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084254340 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17f5160c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084254340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084254340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084254340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084254340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084254342 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084254342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084254343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084254343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:55.342713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15807): Terminating (SIGTERM) 08:42:55.384664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15810): Terminating (SIGTERM) 08:42:55.426876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15813): Terminating (SIGTERM) 08:42:55.469335 --- ParallelTerminationStrategy: PID 15807 died... 08:42:55.489276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15807): Terminated: ok {rc=0} 08:42:55.536000 --- ParallelTerminationStrategy: PID 15810 died... 08:42:55.555557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15810): Terminated: ok {rc=0} 08:42:55.602009 --- ParallelTerminationStrategy: PID 15813 died... 08:42:55.621512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15813): Terminated: ok {rc=0} 08:42:55.710321 bus /sierra_3: Setting Powered False 08:42:56.810131 bus /sierra_3: Setting Powered False 08:42:57.927857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:42:59.184216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:59.191567 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:42:59.225151 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:42:59.252025 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:42:59.304128 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:42:59.337663 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:42:59.364779 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:42:59.917250 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:42:59.966458 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:42:59.977949 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:43:00.047822 tst mo_mt_call.py: using LAC 20277 08:43:00.169802 tst mo_mt_call.py: using RAC 132 08:43:00.291217 tst mo_mt_call.py: using CellId 20277 08:43:00.421962 tst mo_mt_call.py: using BVCI 20278 08:43:00.535125 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:00.546414 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:00.557549 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:00.568925 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:00.580661 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:00.592017 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:43:00.713240 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:43:00.842838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:01.373100 run create_hlr_db(pid=15819): Launched 08:43:01.536879 bus /sierra_2: Setting Powered False 08:43:02.598612 run create_hlr_db(pid=15819): Terminated: ok {rc=0} 08:43:03.047858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15821): Launched 08:43:03.377706 run osmo-hlr_10.42.42.2(pid=15822): Launched 08:43:03.504137 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:04.073385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15824): Launched 08:43:04.403538 run osmo-stp_10.42.42.5(pid=15825): Launched 08:43:04.529509 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:05.125732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15827): Launched 08:43:05.454181 run osmo-msc_10.42.42.6(pid=15828): Launched 08:43:05.639232 run osmo-stp_10.42.42.5(pid=15825): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15825)] 08:43:05.778527 run osmo-stp_10.42.42.5(pid=15825): stdout: | (launched: 2022-12-09_08:43:04.343816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:05.918181 run osmo-stp_10.42.42.5(pid=15825): stderr: | [0;m[38;5;43m20221209084304533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084304533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084304534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084304534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084304535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084304535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084304535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:06.056014 run osmo-stp_10.42.42.5(pid=15825): stdout: | (launched: 2022-12-09_08:43:04.343816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:06.188401 run osmo-stp_10.42.42.5(pid=15825): stderr: | [0;m[38;5;43m20221209084304533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084304533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084304534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084304534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084304535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084304535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084304535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:06.346159 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15825): Process ended prematurely: osmo-stp_10.42.42.5(pid=15825) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15825)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:43:06.355888 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:43:06.385642 run osmo-hlr_10.42.42.2(pid=15822): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15822)] 08:43:06.436581 run osmo-hlr_10.42.42.2(pid=15822): stdout: | (launched: 2022-12-09_08:43:03.317568) 08:43:06.488796 run osmo-hlr_10.42.42.2(pid=15822): stderr: | [0;m[1;31m20221209084303514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084303514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084303514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084303514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084303514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084303514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084303526 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084303535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084303535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084303535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:06.561567 run osmo-msc_10.42.42.6(pid=15828): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15828)] 08:43:06.612018 run osmo-msc_10.42.42.6(pid=15828): stdout: | (launched: 2022-12-09_08:43:05.394628) 08:43:06.664016 run osmo-msc_10.42.42.6(pid=15828): stderr: | [0;m[38;5;43m20221209084305716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084305717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2fb6847c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084305717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084305717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084305717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084305717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084305719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084305719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084305719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084305719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:06.716516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15821): Terminating (SIGTERM) 08:43:06.758493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15824): Terminating (SIGTERM) 08:43:06.800647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15827): Terminating (SIGTERM) 08:43:06.843702 --- ParallelTerminationStrategy: PID 15821 died... 08:43:06.863793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15821): Terminated: ok {rc=0} 08:43:06.910770 --- ParallelTerminationStrategy: PID 15824 died... 08:43:06.930516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15824): Terminated: ok {rc=0} 08:43:06.977712 --- ParallelTerminationStrategy: PID 15827 died... 08:43:06.997529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15827): Terminated: ok {rc=0} 08:43:07.087227 bus /sierra_3: Setting Powered False 08:43:08.187728 bus /sierra_3: Setting Powered False 08:43:09.305569 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:43:10.456515 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:10.469269 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:43:10.542518 tst mo_mt_call_osmux.py: using LAC 20278 08:43:10.672640 tst mo_mt_call_osmux.py: using RAC 133 08:43:10.802267 tst mo_mt_call_osmux.py: using CellId 20278 08:43:10.934332 tst mo_mt_call_osmux.py: using BVCI 20279 08:43:11.055423 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:11.067236 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:11.078758 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:11.090666 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:11.102482 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:43:11.114428 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:43:11.235128 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:43:11.357386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:11.873105 run create_hlr_db(pid=15830): Launched 08:43:11.998801 bus /sierra_2: Setting Powered False 08:43:13.063295 run create_hlr_db(pid=15830): Terminated: ok {rc=0} 08:43:13.502999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15832): Launched 08:43:13.812027 run osmo-hlr_10.42.42.2(pid=15833): Launched 08:43:13.930472 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:14.480531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15835): Launched 08:43:14.788574 run osmo-stp_10.42.42.5(pid=15836): Launched 08:43:14.907200 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:15.466133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15838): Launched 08:43:15.775342 run osmo-msc_10.42.42.6(pid=15839): Launched 08:43:16.111277 run osmo-stp_10.42.42.5(pid=15836): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15836)] 08:43:16.309780 run osmo-stp_10.42.42.5(pid=15836): stdout: | (launched: 2022-12-09_08:43:14.732354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:16.548902 run osmo-stp_10.42.42.5(pid=15836): stderr: | [0;m[38;5;43m20221209084314900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084314900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084314900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084314901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084314901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084314901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084314901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:16.697221 run osmo-stp_10.42.42.5(pid=15836): stdout: | (launched: 2022-12-09_08:43:14.732354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:16.838354 run osmo-stp_10.42.42.5(pid=15836): stderr: | [0;m[38;5;43m20221209084314900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084314900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084314900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084314901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084314901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084314901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084314901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:17.002142 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15836): Process ended prematurely: osmo-stp_10.42.42.5(pid=15836) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15836)] [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:43:17.014094 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:43:17.046230 run osmo-hlr_10.42.42.2(pid=15833): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15833)] 08:43:17.099582 run osmo-hlr_10.42.42.2(pid=15833): stdout: | (launched: 2022-12-09_08:43:13.755739) 08:43:17.154238 run osmo-hlr_10.42.42.2(pid=15833): stderr: | [0;m[1;31m20221209084313929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084313929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084313929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084313929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084313929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084313929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084313942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084313952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084313952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084313952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:17.231567 run osmo-msc_10.42.42.6(pid=15839): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15839)] 08:43:17.284743 run osmo-msc_10.42.42.6(pid=15839): stdout: | (launched: 2022-12-09_08:43:15.718719) 08:43:17.339490 run osmo-msc_10.42.42.6(pid=15839): stderr: | [0;m[38;5;43m20221209084316060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084316060 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fecfb89ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084316060 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084316060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084316061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084316061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084316062 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084316063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084316063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084316063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:17.395107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15832): Terminating (SIGTERM) 08:43:17.438469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15835): Terminating (SIGTERM) 08:43:17.482021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15838): Terminating (SIGTERM) 08:43:17.525765 --- ParallelTerminationStrategy: PID 15832 died... 08:43:17.546346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15832): Terminated: ok {rc=0} 08:43:17.594646 --- ParallelTerminationStrategy: PID 15835 died... 08:43:17.614401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15835): Terminated: ok {rc=0} 08:43:17.662100 --- ParallelTerminationStrategy: PID 15838 died... 08:43:17.681906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15838): Terminated: ok {rc=0} 08:43:17.772465 bus /sierra_3: Setting Powered False 08:43:18.870514 bus /sierra_3: Setting Powered False 08:43:19.986748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:43:21.245731 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:21.253190 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:43:21.288929 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:43:21.317200 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:43:21.372993 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:43:21.408466 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:43:21.436514 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:43:21.993167 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:43:22.046303 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:22.058195 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:43:22.130346 tst mo_mt_call.py: using LAC 20279 08:43:22.260898 tst mo_mt_call.py: using RAC 134 08:43:22.392065 tst mo_mt_call.py: using CellId 20279 08:43:22.520395 tst mo_mt_call.py: using BVCI 20280 08:43:22.640252 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:22.652111 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:22.663739 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:22.675504 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:22.687363 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:22.699178 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:43:22.817397 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:43:22.935157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:23.415280 run create_hlr_db(pid=15844): Launched 08:43:23.541112 bus /sierra_2: Setting Powered False 08:43:24.602378 run create_hlr_db(pid=15844): Terminated: ok {rc=0} 08:43:25.052911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15846): Launched 08:43:25.383166 run osmo-hlr_10.42.42.2(pid=15847): Launched 08:43:25.510824 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:26.079499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15849): Launched 08:43:26.411909 run osmo-stp_10.42.42.5(pid=15850): Launched 08:43:26.537837 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:27.135761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15852): Launched 08:43:27.466908 run osmo-msc_10.42.42.6(pid=15853): Launched 08:43:27.651485 run osmo-stp_10.42.42.5(pid=15850): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15850)] 08:43:27.791698 run osmo-stp_10.42.42.5(pid=15850): stdout: | (launched: 2022-12-09_08:43:26.352078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:27.931723 run osmo-stp_10.42.42.5(pid=15850): stderr: | [0;m[38;5;43m20221209084326541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084326541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084326542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084326542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084326542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084326543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084326543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:28.069742 run osmo-stp_10.42.42.5(pid=15850): stdout: | (launched: 2022-12-09_08:43:26.352078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:28.201678 run osmo-stp_10.42.42.5(pid=15850): stderr: | [0;m[38;5;43m20221209084326541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084326541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084326542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084326542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084326542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084326543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084326543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:28.359983 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15850): Process ended prematurely: osmo-stp_10.42.42.5(pid=15850) [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15850)] [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:43:28.369635 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:43:28.398075 run osmo-hlr_10.42.42.2(pid=15847): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15847)] 08:43:28.449401 run osmo-hlr_10.42.42.2(pid=15847): stdout: | (launched: 2022-12-09_08:43:25.323384) 08:43:28.501788 run osmo-hlr_10.42.42.2(pid=15847): stderr: | [0;m[1;31m20221209084325521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084325521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084325521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084325521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084325521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084325521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084325534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084325542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084325543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084325543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:28.574766 run osmo-msc_10.42.42.6(pid=15853): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15853)] 08:43:28.625327 run osmo-msc_10.42.42.6(pid=15853): stdout: | (launched: 2022-12-09_08:43:27.406967) 08:43:28.677456 run osmo-msc_10.42.42.6(pid=15853): stderr: | [0;m[38;5;43m20221209084327731 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084327731 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25d46b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084327731 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084327731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084327731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084327731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084327733 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084327734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084327734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084327734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:28.730142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15846): Terminating (SIGTERM) 08:43:28.772353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15849): Terminating (SIGTERM) 08:43:28.814923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15852): Terminating (SIGTERM) 08:43:28.857582 --- ParallelTerminationStrategy: PID 15846 died... 08:43:28.877691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15846): Terminated: ok {rc=0} 08:43:28.924430 --- ParallelTerminationStrategy: PID 15849 died... 08:43:28.944104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15849): Terminated: ok {rc=0} 08:43:28.990480 --- ParallelTerminationStrategy: PID 15852 died... 08:43:29.010137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15852): Terminated: ok {rc=0} 08:43:29.098844 bus /sierra_3: Setting Powered False 08:43:30.198041 bus /sierra_3: Setting Powered False 08:43:31.316044 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:43:32.468054 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:32.480587 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:43:32.553381 tst mo_mt_call_osmux.py: using LAC 20280 08:43:32.684424 tst mo_mt_call_osmux.py: using RAC 135 08:43:32.813220 tst mo_mt_call_osmux.py: using CellId 20280 08:43:32.943291 tst mo_mt_call_osmux.py: using BVCI 20281 08:43:33.065139 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:33.076922 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:33.088542 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:33.100262 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:33.112273 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:43:33.124167 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:43:33.242944 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:43:33.364753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:33.880508 run create_hlr_db(pid=15855): Launched 08:43:34.006388 bus /sierra_2: Setting Powered False 08:43:35.071651 run create_hlr_db(pid=15855): Terminated: ok {rc=0} 08:43:35.513294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15857): Launched 08:43:35.832179 run osmo-hlr_10.42.42.2(pid=15858): Launched 08:43:35.960668 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:36.530698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15860): Launched 08:43:36.863358 run osmo-stp_10.42.42.5(pid=15861): Launched 08:43:36.989585 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:37.586488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15863): Launched 08:43:37.919021 run osmo-msc_10.42.42.6(pid=15864): Launched 08:43:38.103997 run osmo-stp_10.42.42.5(pid=15861): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15861)] 08:43:38.244032 run osmo-stp_10.42.42.5(pid=15861): stdout: | (launched: 2022-12-09_08:43:36.803376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:38.384337 run osmo-stp_10.42.42.5(pid=15861): stderr: | [0;m[38;5;43m20221209084336992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084336992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084336992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084336993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084336993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084336993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084336993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:38.523305 run osmo-stp_10.42.42.5(pid=15861): stdout: | (launched: 2022-12-09_08:43:36.803376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:38.655894 run osmo-stp_10.42.42.5(pid=15861): stderr: | [0;m[38;5;43m20221209084336992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084336992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084336992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084336993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084336993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084336993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084336993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:38.815369 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15861): Process ended prematurely: osmo-stp_10.42.42.5(pid=15861) [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15861)] [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:43:38.825309 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:43:38.854320 run osmo-hlr_10.42.42.2(pid=15858): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15858)] 08:43:38.905629 run osmo-hlr_10.42.42.2(pid=15858): stdout: | (launched: 2022-12-09_08:43:35.771536) 08:43:38.958483 run osmo-hlr_10.42.42.2(pid=15858): stderr: | [0;m[1;31m20221209084335966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084335966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084335966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084335966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084335966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084335966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084335978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084335986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084335987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084335987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:39.032395 run osmo-msc_10.42.42.6(pid=15864): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15864)] 08:43:39.083444 run osmo-msc_10.42.42.6(pid=15864): stdout: | (launched: 2022-12-09_08:43:37.858431) 08:43:39.136236 run osmo-msc_10.42.42.6(pid=15864): stderr: | [0;m[38;5;43m20221209084338178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084338178 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71a0b80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084338179 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084338179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084338179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084338179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084338181 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084338181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084338181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084338181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:39.189794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15857): Terminating (SIGTERM) 08:43:39.232588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15860): Terminating (SIGTERM) 08:43:39.275569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15863): Terminating (SIGTERM) 08:43:39.318568 --- ParallelTerminationStrategy: PID 15857 died... 08:43:39.338717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15857): Terminated: ok {rc=0} 08:43:39.386207 --- ParallelTerminationStrategy: PID 15860 died... 08:43:39.406017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15860): Terminated: ok {rc=0} 08:43:39.453343 --- ParallelTerminationStrategy: PID 15863 died... 08:43:39.473274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15863): Terminated: ok {rc=0} 08:43:39.563044 bus /sierra_3: Setting Powered False 08:43:40.663015 bus /sierra_3: Setting Powered False 08:43:41.782124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:43:43.041699 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:43.047806 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:43:43.081533 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:43:43.108806 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:43:43.161731 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:43:43.195632 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:43:43.222602 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:43:43.772568 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:43:43.821960 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:43.833063 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:43:43.903917 tst mo_mt_call.py: using LAC 20281 08:43:44.025070 tst mo_mt_call.py: using RAC 136 08:43:44.146307 tst mo_mt_call.py: using CellId 20281 08:43:44.268755 tst mo_mt_call.py: using BVCI 20282 08:43:44.381065 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:44.392165 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:44.403035 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:44.413950 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:44.424809 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:44.435744 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:43:44.556695 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:43:44.676146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:45.157240 run create_hlr_db(pid=15869): Launched 08:43:45.283022 bus /sierra_2: Setting Powered False 08:43:46.347035 run create_hlr_db(pid=15869): Terminated: ok {rc=0} 08:43:46.846795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15871): Launched 08:43:47.174174 run osmo-hlr_10.42.42.2(pid=15872): Launched 08:43:47.299526 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:47.859714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15874): Launched 08:43:48.168378 run osmo-stp_10.42.42.5(pid=15875): Launched 08:43:48.286338 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:48.846977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15877): Launched 08:43:49.158574 run osmo-msc_10.42.42.6(pid=15878): Launched 08:43:49.334986 run osmo-stp_10.42.42.5(pid=15875): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15875)] 08:43:49.466132 run osmo-stp_10.42.42.5(pid=15875): stdout: | (launched: 2022-12-09_08:43:48.111615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:49.596444 run osmo-stp_10.42.42.5(pid=15875): stderr: | [0;m[38;5;43m20221209084348279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084348279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084348280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084348280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084348281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084348281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084348281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:49.724808 run osmo-stp_10.42.42.5(pid=15875): stdout: | (launched: 2022-12-09_08:43:48.111615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:49.848409 run osmo-stp_10.42.42.5(pid=15875): stderr: | [0;m[38;5;43m20221209084348279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084348279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084348280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084348280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084348281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084348281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084348281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:49.995970 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15875): Process ended prematurely: osmo-stp_10.42.42.5(pid=15875) [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15875)] [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:43:50.004861 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:43:50.031470 run osmo-hlr_10.42.42.2(pid=15872): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15872)] 08:43:50.079976 run osmo-hlr_10.42.42.2(pid=15872): stdout: | (launched: 2022-12-09_08:43:47.116086) 08:43:50.130008 run osmo-hlr_10.42.42.2(pid=15872): stderr: | [0;m[1;31m20221209084347392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084347392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084347392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084347392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084347392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084347392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084347404 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084347413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084347414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084347414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:50.199788 run osmo-msc_10.42.42.6(pid=15878): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15878)] 08:43:50.247981 run osmo-msc_10.42.42.6(pid=15878): stdout: | (launched: 2022-12-09_08:43:49.102051) 08:43:50.297900 run osmo-msc_10.42.42.6(pid=15878): stderr: | [0;m[38;5;43m20221209084349371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084349371 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa9ecdfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084349371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084349371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084349371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084349371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084349373 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084349374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084349374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084349374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:43:50.348178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15871): Terminating (SIGTERM) 08:43:50.388504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15874): Terminating (SIGTERM) 08:43:50.428682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15877): Terminating (SIGTERM) 08:43:50.469197 --- ParallelTerminationStrategy: PID 15871 died... 08:43:50.488381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15871): Terminated: ok {rc=0} 08:43:50.533341 --- ParallelTerminationStrategy: PID 15874 died... 08:43:50.552039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15874): Terminated: ok {rc=0} 08:43:50.596187 --- ParallelTerminationStrategy: PID 15877 died... 08:43:50.614946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15877): Terminated: ok {rc=0} 08:43:50.701595 bus /sierra_3: Setting Powered False 08:43:51.803464 bus /sierra_3: Setting Powered False 08:43:52.920534 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:43:54.069576 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:54.081347 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:43:54.152853 tst mo_mt_call_osmux.py: using LAC 20282 08:43:54.274702 tst mo_mt_call_osmux.py: using RAC 137 08:43:54.398465 tst mo_mt_call_osmux.py: using CellId 20282 08:43:54.522240 tst mo_mt_call_osmux.py: using BVCI 20283 08:43:54.646044 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:54.658076 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:54.669874 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:54.682070 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:54.694183 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:43:54.706249 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:43:54.830400 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:43:54.949728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:55.432519 run create_hlr_db(pid=15880): Launched 08:43:55.559418 bus /sierra_2: Setting Powered False 08:43:56.621973 run create_hlr_db(pid=15880): Terminated: ok {rc=0} 08:43:57.073673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15882): Launched 08:43:57.405593 run osmo-hlr_10.42.42.2(pid=15883): Launched 08:43:57.534588 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:58.108571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15885): Launched 08:43:58.440277 run osmo-stp_10.42.42.5(pid=15886): Launched 08:43:58.567623 run osmo-msc_10.42.42.6: Starting osmo-msc 08:43:59.168071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15888): Launched 08:43:59.498972 run osmo-msc_10.42.42.6(pid=15889): Launched 08:43:59.686089 run osmo-stp_10.42.42.5(pid=15886): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15886)] 08:43:59.825860 run osmo-stp_10.42.42.5(pid=15886): stdout: | (launched: 2022-12-09_08:43:58.380101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:59.966601 run osmo-stp_10.42.42.5(pid=15886): stderr: | [0;m[38;5;43m20221209084358570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084358570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084358570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084358571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084358571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084358571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084358571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:00.105192 run osmo-stp_10.42.42.5(pid=15886): stdout: | (launched: 2022-12-09_08:43:58.380101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:00.238111 run osmo-stp_10.42.42.5(pid=15886): stderr: | [0;m[38;5;43m20221209084358570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084358570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084358570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084358571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084358571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084358571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084358571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:00.397197 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15886): Process ended prematurely: osmo-stp_10.42.42.5(pid=15886) [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15886)] [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:44:00.407065 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:44:00.436239 run osmo-hlr_10.42.42.2(pid=15883): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15883)] 08:44:00.487295 run osmo-hlr_10.42.42.2(pid=15883): stdout: | (launched: 2022-12-09_08:43:57.345731) 08:44:00.540062 run osmo-hlr_10.42.42.2(pid=15883): stderr: | [0;m[1;31m20221209084357542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084357542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084357542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084357542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084357542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084357542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084357555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084357563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084357564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084357564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:00.613643 run osmo-msc_10.42.42.6(pid=15889): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15889)] 08:44:00.664846 run osmo-msc_10.42.42.6(pid=15889): stdout: | (launched: 2022-12-09_08:43:59.439047) 08:44:00.717485 run osmo-msc_10.42.42.6(pid=15889): stderr: | [0;m[38;5;43m20221209084359762 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084359762 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8396e42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084359762 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084359762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084359762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084359763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084359764 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084359765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084359765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084359765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:00.770474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15882): Terminating (SIGTERM) 08:44:00.813691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15885): Terminating (SIGTERM) 08:44:00.856718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15888): Terminating (SIGTERM) 08:44:00.908901 --- ParallelTerminationStrategy: PID 15882 died... 08:44:00.933411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15882): Terminated: ok {rc=0} 08:44:00.981325 --- ParallelTerminationStrategy: PID 15885 died... 08:44:01.001488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15885): Terminated: ok {rc=0} 08:44:01.049630 --- ParallelTerminationStrategy: PID 15888 died... 08:44:01.074410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15888): Terminated: ok {rc=0} 08:44:01.174996 bus /sierra_3: Setting Powered False 08:44:02.297633 bus /sierra_3: Setting Powered False 08:44:03.417676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 08:44:04.679196 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:04.684475 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 08:44:04.718794 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 08:44:04.746064 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 08:44:04.799195 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 08:44:04.833063 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 08:44:04.859900 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 08:44:05.409894 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 08:44:05.459266 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:05.470426 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:44:05.522026 tst mo_mt_call.py: using LAC 20283 08:44:05.645212 tst mo_mt_call.py: using RAC 138 08:44:05.768501 tst mo_mt_call.py: using CellId 20283 08:44:05.896031 tst mo_mt_call.py: using BVCI 20284 08:44:06.009377 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:06.020420 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:06.031376 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:06.042261 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:06.053127 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:06.064037 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:44:06.185850 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:44:06.306265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:06.819693 run create_hlr_db(pid=15894): Launched 08:44:06.945900 bus /sierra_2: Setting Powered False 08:44:08.011329 run create_hlr_db(pid=15894): Terminated: ok {rc=0} 08:44:08.451718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15896): Launched 08:44:08.761994 run osmo-hlr_10.42.42.2(pid=15897): Launched 08:44:08.880039 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:09.412357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15899): Launched 08:44:09.721694 run osmo-stp_10.42.42.5(pid=15900): Launched 08:44:09.840151 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:10.399478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15902): Launched 08:44:10.710371 run osmo-msc_10.42.42.6(pid=15903): Launched 08:44:10.885286 run osmo-stp_10.42.42.5(pid=15900): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15900)] 08:44:11.015677 run osmo-stp_10.42.42.5(pid=15900): stdout: | (launched: 2022-12-09_08:44:09.665481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:11.146286 run osmo-stp_10.42.42.5(pid=15900): stderr: | [0;m[38;5;43m20221209084409835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084409835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084409836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084409836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084409837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084409837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084409837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:11.274819 run osmo-stp_10.42.42.5(pid=15900): stdout: | (launched: 2022-12-09_08:44:09.665481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:11.398368 run osmo-stp_10.42.42.5(pid=15900): stderr: | [0;m[38;5;43m20221209084409835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084409835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084409836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084409836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084409837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084409837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084409837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:11.546530 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15900): Process ended prematurely: osmo-stp_10.42.42.5(pid=15900) [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15900)] [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 08:44:11.555680 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:44:11.582289 run osmo-hlr_10.42.42.2(pid=15897): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15897)] 08:44:11.630388 run osmo-hlr_10.42.42.2(pid=15897): stdout: | (launched: 2022-12-09_08:44:08.705819) 08:44:11.680218 run osmo-hlr_10.42.42.2(pid=15897): stderr: | [0;m[1;31m20221209084408880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084408880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084408880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084408880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084408880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084408880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084408893 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084408903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084408903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084408903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:11.749665 run osmo-msc_10.42.42.6(pid=15903): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15903)] 08:44:11.797510 run osmo-msc_10.42.42.6(pid=15903): stdout: | (launched: 2022-12-09_08:44:10.652938) 08:44:11.847097 run osmo-msc_10.42.42.6(pid=15903): stderr: | [0;m[38;5;43m20221209084410924 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084410924 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb9c4b28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084410924 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084410924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084410924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084410924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084410926 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084410927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084410927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084410927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:11.897729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15896): Terminating (SIGTERM) 08:44:11.937903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15899): Terminating (SIGTERM) 08:44:11.978126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15902): Terminating (SIGTERM) 08:44:12.018435 --- ParallelTerminationStrategy: PID 15896 died... 08:44:12.037815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15896): Terminated: ok {rc=0} 08:44:12.082503 --- ParallelTerminationStrategy: PID 15899 died... 08:44:12.101475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15899): Terminated: ok {rc=0} 08:44:12.145823 --- ParallelTerminationStrategy: PID 15902 died... 08:44:12.164581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15902): Terminated: ok {rc=0} 08:44:12.249921 bus /sierra_3: Setting Powered False 08:44:13.349686 bus /sierra_3: Setting Powered False 08:44:14.467550 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 08:44:15.618853 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:15.631262 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:44:15.684629 tst mo_mt_call_osmux.py: using LAC 20284 08:44:15.815128 tst mo_mt_call_osmux.py: using RAC 139 08:44:15.983303 tst mo_mt_call_osmux.py: using CellId 20284 08:44:16.116903 tst mo_mt_call_osmux.py: using BVCI 20285 08:44:16.269166 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:16.286543 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:16.304280 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:16.321848 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:16.338521 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:44:16.354572 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:44:16.501933 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:44:16.630932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:17.160459 run create_hlr_db(pid=15905): Launched 08:44:17.318471 bus /sierra_2: Setting Powered False 08:44:18.379967 run create_hlr_db(pid=15905): Terminated: ok {rc=0} 08:44:18.815193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15907): Launched 08:44:19.125409 run osmo-hlr_10.42.42.2(pid=15908): Launched 08:44:19.243057 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:19.789293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15910): Launched 08:44:20.098036 run osmo-stp_10.42.42.5(pid=15911): Launched 08:44:20.215687 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:20.774267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15913): Launched 08:44:21.085653 run osmo-msc_10.42.42.6(pid=15914): Launched 08:44:21.258759 run osmo-stp_10.42.42.5(pid=15911): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15911)] 08:44:21.388787 run osmo-stp_10.42.42.5(pid=15911): stdout: | (launched: 2022-12-09_08:44:20.041707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:21.519474 run osmo-stp_10.42.42.5(pid=15911): stderr: | [0;m[38;5;43m20221209084420212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084420212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084420212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084420213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084420213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084420213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084420213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:21.647986 run osmo-stp_10.42.42.5(pid=15911): stdout: | (launched: 2022-12-09_08:44:20.041707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:21.771829 run osmo-stp_10.42.42.5(pid=15911): stderr: | [0;m[38;5;43m20221209084420212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084420212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084420212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084420213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084420213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084420213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084420213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:21.919966 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15911): Process ended prematurely: osmo-stp_10.42.42.5(pid=15911) [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15911)] [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 08:44:21.929075 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:44:21.955359 run osmo-hlr_10.42.42.2(pid=15908): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15908)] 08:44:22.003716 run osmo-hlr_10.42.42.2(pid=15908): stdout: | (launched: 2022-12-09_08:44:19.068603) 08:44:22.053491 run osmo-hlr_10.42.42.2(pid=15908): stderr: | [0;m[1;31m20221209084419244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084419244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084419244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084419244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084419244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084419244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084419256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084419264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084419265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084419265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:22.122654 run osmo-msc_10.42.42.6(pid=15914): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15914)] 08:44:22.170811 run osmo-msc_10.42.42.6(pid=15914): stdout: | (launched: 2022-12-09_08:44:21.029365) 08:44:22.220411 run osmo-msc_10.42.42.6(pid=15914): stderr: | [0;m[38;5;43m20221209084421298 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084421298 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f955a3dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084421298 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084421298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084421298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084421298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084421300 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084421300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084421301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084421301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:22.270320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15907): Terminating (SIGTERM) 08:44:22.310255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15910): Terminating (SIGTERM) 08:44:22.350341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15913): Terminating (SIGTERM) 08:44:22.390624 --- ParallelTerminationStrategy: PID 15907 died... 08:44:22.409819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15907): Terminated: ok {rc=0} 08:44:22.454123 --- ParallelTerminationStrategy: PID 15910 died... 08:44:22.473016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15910): Terminated: ok {rc=0} 08:44:22.516903 --- ParallelTerminationStrategy: PID 15913 died... 08:44:22.535977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15913): Terminated: ok {rc=0} 08:44:22.623038 bus /sierra_3: Setting Powered False 08:44:23.721895 bus /sierra_3: Setting Powered False 08:44:24.837706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:44:26.099159 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:26.105670 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:44:26.141530 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:44:26.169887 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:44:26.225236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:44:26.261107 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:44:26.289559 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:44:26.843624 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:44:26.897316 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:26.909426 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:44:26.963979 tst mo_mt_call.py: using LAC 20285 08:44:27.094688 tst mo_mt_call.py: using RAC 140 08:44:27.225384 tst mo_mt_call.py: using CellId 20285 08:44:27.356194 tst mo_mt_call.py: using BVCI 20286 08:44:27.476305 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:27.488470 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:27.500409 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:27.513149 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:27.525855 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:27.538659 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:44:27.658257 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:44:27.780890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:28.262367 run create_hlr_db(pid=15919): Launched 08:44:28.390840 bus /sierra_2: Setting Powered False 08:44:29.452344 run create_hlr_db(pid=15919): Terminated: ok {rc=0} 08:44:29.903802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15921): Launched 08:44:30.234749 run osmo-hlr_10.42.42.2(pid=15922): Launched 08:44:30.362044 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:30.944660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15924): Launched 08:44:31.298036 run osmo-stp_10.42.42.5(pid=15925): Launched 08:44:31.524416 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:32.184163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15927): Launched 08:44:32.495951 run osmo-msc_10.42.42.6(pid=15928): Launched 08:44:32.670857 run osmo-stp_10.42.42.5(pid=15925): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15925)] 08:44:32.805901 run osmo-stp_10.42.42.5(pid=15925): stdout: | (launched: 2022-12-09_08:44:31.235004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:32.947978 run osmo-stp_10.42.42.5(pid=15925): stderr: | [0;m[38;5;43m20221209084431535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084431535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084431535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084431536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084431536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084431536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084431541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:33.086358 run osmo-stp_10.42.42.5(pid=15925): stdout: | (launched: 2022-12-09_08:44:31.235004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:33.219369 run osmo-stp_10.42.42.5(pid=15925): stderr: | [0;m[38;5;43m20221209084431535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084431535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084431535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084431536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084431536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084431536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084431541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:33.378292 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15925): Process ended prematurely: osmo-stp_10.42.42.5(pid=15925) [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15925)] [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:44:33.388177 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:44:33.417161 run osmo-hlr_10.42.42.2(pid=15922): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15922)] 08:44:33.468067 run osmo-hlr_10.42.42.2(pid=15922): stdout: | (launched: 2022-12-09_08:44:30.174692) 08:44:33.521221 run osmo-hlr_10.42.42.2(pid=15922): stderr: | [0;m[1;31m20221209084430370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084430370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084430370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084430370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084430370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084430370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084430386 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084430396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084430396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084430396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:33.594637 run osmo-msc_10.42.42.6(pid=15928): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15928)] 08:44:33.645773 run osmo-msc_10.42.42.6(pid=15928): stdout: | (launched: 2022-12-09_08:44:32.438761) 08:44:33.698542 run osmo-msc_10.42.42.6(pid=15928): stderr: | [0;m[38;5;43m20221209084432712 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084432712 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0eae03dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084432712 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084432712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084432713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084432713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084432714 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084432715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084432715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084432715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:33.751900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15921): Terminating (SIGTERM) 08:44:33.794848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15924): Terminating (SIGTERM) 08:44:33.837991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15927): Terminating (SIGTERM) 08:44:33.881234 --- ParallelTerminationStrategy: PID 15921 died... 08:44:33.901539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15921): Terminated: ok {rc=0} 08:44:33.948911 --- ParallelTerminationStrategy: PID 15924 died... 08:44:33.968920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15924): Terminated: ok {rc=0} 08:44:34.016184 --- ParallelTerminationStrategy: PID 15927 died... 08:44:34.036137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15927): Terminated: ok {rc=0} 08:44:34.126530 bus /sierra_3: Setting Powered False 08:44:35.225734 bus /sierra_3: Setting Powered False 08:44:36.342065 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:44:37.493056 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:37.506070 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:44:37.563002 tst mo_mt_call_osmux.py: using LAC 20286 08:44:37.692562 tst mo_mt_call_osmux.py: using RAC 141 08:44:37.822269 tst mo_mt_call_osmux.py: using CellId 20286 08:44:37.952804 tst mo_mt_call_osmux.py: using BVCI 20287 08:44:38.074687 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:38.086762 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:38.098712 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:38.110771 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:38.122778 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:44:38.135085 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:44:38.255937 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:44:38.380118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:38.861326 run create_hlr_db(pid=15930): Launched 08:44:38.988713 bus /sierra_2: Setting Powered False 08:44:40.050614 run create_hlr_db(pid=15930): Terminated: ok {rc=0} 08:44:40.501387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15932): Launched 08:44:40.831791 run osmo-hlr_10.42.42.2(pid=15933): Launched 08:44:40.959125 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:41.528685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15935): Launched 08:44:41.858469 run osmo-stp_10.42.42.5(pid=15936): Launched 08:44:41.985183 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:42.582841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15938): Launched 08:44:42.913194 run osmo-msc_10.42.42.6(pid=15939): Launched 08:44:43.098738 run osmo-stp_10.42.42.5(pid=15936): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15936)] 08:44:43.238019 run osmo-stp_10.42.42.5(pid=15936): stdout: | (launched: 2022-12-09_08:44:41.798480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:43.378131 run osmo-stp_10.42.42.5(pid=15936): stderr: | [0;m[38;5;43m20221209084441988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084441988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084441988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084441989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084441989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084441989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084441989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:43.515804 run osmo-stp_10.42.42.5(pid=15936): stdout: | (launched: 2022-12-09_08:44:41.798480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:43.648196 run osmo-stp_10.42.42.5(pid=15936): stderr: | [0;m[38;5;43m20221209084441988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084441988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084441988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084441989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084441989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084441989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084441989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:43.806012 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15936): Process ended prematurely: osmo-stp_10.42.42.5(pid=15936) [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15936)] [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:44:43.815794 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:44:43.844563 run osmo-hlr_10.42.42.2(pid=15933): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15933)] 08:44:43.895439 run osmo-hlr_10.42.42.2(pid=15933): stdout: | (launched: 2022-12-09_08:44:40.771908) 08:44:43.947893 run osmo-hlr_10.42.42.2(pid=15933): stderr: | [0;m[1;31m20221209084440968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084440969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084440969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084440969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084440969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084440969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084440981 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084440990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084440990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084440990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:44.020567 run osmo-msc_10.42.42.6(pid=15939): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15939)] 08:44:44.070659 run osmo-msc_10.42.42.6(pid=15939): stdout: | (launched: 2022-12-09_08:44:42.853384) 08:44:44.122905 run osmo-msc_10.42.42.6(pid=15939): stderr: | [0;m[38;5;43m20221209084443174 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084443174 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f31981a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084443174 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084443174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084443174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084443175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084443176 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084443177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084443177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084443177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:44.175521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15932): Terminating (SIGTERM) 08:44:44.217775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15935): Terminating (SIGTERM) 08:44:44.260187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15938): Terminating (SIGTERM) 08:44:44.302626 --- ParallelTerminationStrategy: PID 15932 died... 08:44:44.322760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15932): Terminated: ok {rc=0} 08:44:44.369914 --- ParallelTerminationStrategy: PID 15935 died... 08:44:44.389856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15935): Terminated: ok {rc=0} 08:44:44.437043 --- ParallelTerminationStrategy: PID 15938 died... 08:44:44.456874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15938): Terminated: ok {rc=0} 08:44:44.545892 bus /sierra_3: Setting Powered False 08:44:45.647030 bus /sierra_3: Setting Powered False 08:44:46.767312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:trx-b200 --------------------------------------------------------------------- 08:44:48.026744 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:48.031035 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 08:44:48.064797 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:44:48.092090 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 08:44:48.178226 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 08:44:48.211582 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:44:48.238599 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 08:44:48.824257 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 08:44:48.829220 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:48.840019 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:44:48.893224 tst emergency_mo_mt_call.py: using LAC 20287 08:44:49.012770 tst emergency_mo_mt_call.py: using RAC 142 08:44:49.130909 tst emergency_mo_mt_call.py: using CellId 20287 08:44:49.249205 tst emergency_mo_mt_call.py: using BVCI 20288 08:44:49.359979 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:49.370999 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:49.381719 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:49.392399 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:49.403052 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:49.413751 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:44:49.532595 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:44:49.654881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:50.161900 run create_hlr_db(pid=15944): Launched 08:44:50.289457 bus /sierra_2: Setting Powered False 08:44:51.353522 run create_hlr_db(pid=15944): Terminated: ok {rc=0} 08:44:51.789121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15946): Launched 08:44:52.094561 run osmo-hlr_10.42.42.2(pid=15947): Launched 08:44:52.210354 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:52.736559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15949): Launched 08:44:53.041668 run osmo-stp_10.42.42.5(pid=15950): Launched 08:44:53.166871 tst emergency_mo_mt_call.py: using MSISDN 7121 08:44:53.321536 run osmo-msc_10.42.42.6: Starting osmo-msc 08:44:53.867192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15952): Launched 08:44:54.171036 run osmo-msc_10.42.42.6(pid=15953): Launched 08:44:54.339647 run osmo-stp_10.42.42.5(pid=15950): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15950)] 08:44:54.467827 run osmo-stp_10.42.42.5(pid=15950): stdout: | (launched: 2022-12-09_08:44:52.985235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:54.596162 run osmo-stp_10.42.42.5(pid=15950): stderr: | [0;m[38;5;43m20221209084453155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084453155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084453155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084453155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084453156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084453156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084453156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:54.722487 run osmo-stp_10.42.42.5(pid=15950): stdout: | (launched: 2022-12-09_08:44:52.985235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:54.843228 run osmo-stp_10.42.42.5(pid=15950): stderr: | [0;m[38;5;43m20221209084453155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084453155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084453155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084453155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084453156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084453156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084453156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:54.987434 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15950): Process ended prematurely: osmo-stp_10.42.42.5(pid=15950) [trial-2357↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15950)] [trial-2357↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 08:44:54.995870 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 08:44:55.022300 run osmo-hlr_10.42.42.2(pid=15947): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15947)] 08:44:55.070288 run osmo-hlr_10.42.42.2(pid=15947): stdout: | (launched: 2022-12-09_08:44:52.038372) 08:44:55.119521 run osmo-hlr_10.42.42.2(pid=15947): stderr: | [0;m[1;31m20221209084452213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084452213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084452213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084452213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084452213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084452213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084452225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084452234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084452234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084452234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:55.188266 run osmo-msc_10.42.42.6(pid=15953): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15953)] 08:44:55.235742 run osmo-msc_10.42.42.6(pid=15953): stdout: | (launched: 2022-12-09_08:44:54.115172) 08:44:55.285123 run osmo-msc_10.42.42.6(pid=15953): stderr: | [0;m[38;5;43m20221209084454386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084454386 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f798b140c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084454386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084454386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084454386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084454386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084454389 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084454390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084454390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084454390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:44:55.334607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15946): Terminating (SIGTERM) 08:44:55.374294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15949): Terminating (SIGTERM) 08:44:55.413871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15952): Terminating (SIGTERM) 08:44:55.453905 --- ParallelTerminationStrategy: PID 15946 died... 08:44:55.472922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15946): Terminated: ok {rc=0} 08:44:55.517564 --- ParallelTerminationStrategy: PID 15949 died... 08:44:55.536151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15949): Terminated: ok {rc=0} 08:44:55.579731 --- ParallelTerminationStrategy: PID 15952 died... 08:44:55.598489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15952): Terminated: ok {rc=0} 08:44:55.684923 bus /sierra_3: Setting Powered False 08:44:56.785125 bus /sierra_3: Setting Powered False 08:44:57.901700 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 08:44:58.991717 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:59.004048 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:44:59.058876 tst emergency_preemptive_call.py: using LAC 20288 08:44:59.190895 tst emergency_preemptive_call.py: using RAC 143 08:44:59.321710 tst emergency_preemptive_call.py: using CellId 20288 08:44:59.449300 tst emergency_preemptive_call.py: using BVCI 20289 08:44:59.568010 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:59.579608 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:59.590800 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:59.602641 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:59.614635 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:44:59.626498 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:44:59.747868 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:44:59.871223 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:44:59.992088 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:45:00.112791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:00.621140 run create_hlr_db(pid=15955): Launched 08:45:00.746564 bus /sierra_2: Setting Powered False 08:45:01.811352 run create_hlr_db(pid=15955): Terminated: ok {rc=0} 08:45:02.300556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15960): Launched 08:45:02.636309 run osmo-hlr_10.42.42.2(pid=15961): Launched 08:45:02.761560 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:03.289898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15963): Launched 08:45:03.594588 run osmo-stp_10.42.42.5(pid=15964): Launched 08:45:03.719452 tst emergency_preemptive_call.py: using MSISDN 7122 08:45:03.873430 run osmo-msc_10.42.42.6: Starting osmo-msc 08:45:04.416814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15966): Launched 08:45:04.721209 run osmo-msc_10.42.42.6(pid=15967): Launched 08:45:04.891236 run osmo-stp_10.42.42.5(pid=15964): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15964)] 08:45:05.019609 run osmo-stp_10.42.42.5(pid=15964): stdout: | (launched: 2022-12-09_08:45:03.538650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:05.148940 run osmo-stp_10.42.42.5(pid=15964): stderr: | [0;m[38;5;43m20221209084503708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084503708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084503708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084503709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084503709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084503709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084503709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:05.275685 run osmo-stp_10.42.42.5(pid=15964): stdout: | (launched: 2022-12-09_08:45:03.538650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:05.396280 run osmo-stp_10.42.42.5(pid=15964): stderr: | [0;m[38;5;43m20221209084503708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084503708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084503708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084503709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084503709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084503709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084503709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:05.540398 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15964): Process ended prematurely: osmo-stp_10.42.42.5(pid=15964) [trial-2357↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15964)] [trial-2357↪emergency:trx-b200↪emergency_preemptive_call.py:32] 08:45:05.548903 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 08:45:05.575503 run osmo-hlr_10.42.42.2(pid=15961): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15961)] 08:45:05.624306 run osmo-hlr_10.42.42.2(pid=15961): stdout: | (launched: 2022-12-09_08:45:02.576190) 08:45:05.674943 run osmo-hlr_10.42.42.2(pid=15961): stderr: | [0;m[1;31m20221209084502772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084502772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084502772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084502772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084502772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084502772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084502784 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084502793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084502793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084502793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:05.745381 run osmo-msc_10.42.42.6(pid=15967): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15967)] 08:45:05.794210 run osmo-msc_10.42.42.6(pid=15967): stdout: | (launched: 2022-12-09_08:45:04.664934) 08:45:05.844572 run osmo-msc_10.42.42.6(pid=15967): stderr: | [0;m[38;5;43m20221209084504938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209084504938 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f937025fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209084504938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209084504938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209084504938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209084504939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209084504940 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209084504941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209084504942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209084504942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:45:05.894978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15960): Terminating (SIGTERM) 08:45:05.935278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15963): Terminating (SIGTERM) 08:45:05.975542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15966): Terminating (SIGTERM) 08:45:06.016373 --- ParallelTerminationStrategy: PID 15960 died... 08:45:06.035869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15960): Terminated: ok {rc=0} 08:45:06.081354 --- ParallelTerminationStrategy: PID 15963 died... 08:45:06.100460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15963): Terminated: ok {rc=0} 08:45:06.145136 --- ParallelTerminationStrategy: PID 15966 died... 08:45:06.164134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15966): Terminated: ok {rc=0} 08:45:06.252458 bus /sierra_9: Setting Powered False 08:45:07.352832 bus /sierra_9: Setting Powered False 08:45:08.469569 bus /sierra_8: Setting Powered False 08:45:09.570103 bus /sierra_8: Setting Powered False 08:45:10.687856 bus /sierra_3: Setting Powered False 08:45:11.787125 bus /sierra_3: Setting Powered False 08:45:12.906807 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-b200 --------------------------------------------------------------------- 08:45:14.194271 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:14.199077 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 08:45:14.234850 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 08:45:14.275458 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 08:45:14.366926 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 08:45:14.402143 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 08:45:14.442635 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 08:45:15.031838 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 08:45:15.082752 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.093772 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:45:15.143015 tst cs_paging_gprs_active.py: using LAC 20289 08:45:15.266049 tst cs_paging_gprs_active.py: using RAC 144 08:45:15.389547 tst cs_paging_gprs_active.py: using CellId 20289 08:45:15.511062 tst cs_paging_gprs_active.py: using BVCI 20290 08:45:15.625603 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.636306 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.646940 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.657497 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.667937 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.678399 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.688993 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.699467 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:15.710155 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:15.830000 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:15.974773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:45:16.212888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:16.532083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15973): Launched 08:45:16.819667 run iperf3-srv_10.42.42.10(pid=15974): Launched 08:45:16.947464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:45:17.161174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:17.494663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15975): Launched 08:45:17.785524 run iperf3-srv_10.42.42.10(pid=15976): Launched 08:45:17.911705 tst cs_paging_gprs_active.py:38: start network... 08:45:18.135850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:18.650368 run create_hlr_db(pid=15977): Launched 08:45:18.779549 bus /sierra_2: Setting Powered False 08:45:19.845612 run create_hlr_db(pid=15977): Terminated: ok {rc=0} 08:45:20.288526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15979): Launched 08:45:20.599544 run osmo-hlr_10.42.42.2(pid=15980): Launched 08:45:20.718000 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:21.268079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15982): Launched 08:45:21.578717 run osmo-stp_10.42.42.5(pid=15983): Launched 08:45:21.699364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:22.235602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15985): Launched 08:45:22.354587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:22.617618 run patchelf(pid=15986): Launched 08:45:22.790606 run osmo-stp_10.42.42.5(pid=15983): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15983)] 08:45:22.922835 run osmo-stp_10.42.42.5(pid=15983): stdout: | (launched: 2022-12-09_08:45:21.522058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:23.056411 run osmo-stp_10.42.42.5(pid=15983): stderr: | [0;m[38;5;43m20221209084521691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084521691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084521691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084521692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084521692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084521693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084521693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:23.189983 run osmo-stp_10.42.42.5(pid=15983): stdout: | (launched: 2022-12-09_08:45:21.522058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:23.317920 run osmo-stp_10.42.42.5(pid=15983): stderr: | [0;m[38;5;43m20221209084521691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084521691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084521691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084521692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084521692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084521693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084521693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:23.468710 run patchelf(pid=15986): Terminating (SIGINT) 08:45:23.642583 run patchelf(pid=15986): Terminated: ok {rc=0} 08:45:23.767983 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15983): Process ended prematurely: osmo-stp_10.42.42.5(pid=15983) [trial-2357↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15983)] [trial-2357↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 08:45:23.777614 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:45:23.805134 run osmo-hlr_10.42.42.2(pid=15980): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15980)] 08:45:23.853349 run osmo-hlr_10.42.42.2(pid=15980): stdout: | (launched: 2022-12-09_08:45:20.542749) 08:45:23.903178 run osmo-hlr_10.42.42.2(pid=15980): stderr: | [0;m[1;31m20221209084520719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084520719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084520719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084520719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084520719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084520719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084520731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084520739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084520739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084520739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:23.953954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15973): Terminating (SIGTERM) 08:45:23.994471 run iperf3-srv_10.42.42.10(pid=15974): Terminating (SIGTERM) 08:45:24.034987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15975): Terminating (SIGTERM) 08:45:24.075581 run iperf3-srv_10.42.42.10(pid=15976): Terminating (SIGTERM) 08:45:24.115908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15979): Terminating (SIGTERM) 08:45:24.156533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15982): Terminating (SIGTERM) 08:45:24.196943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15985): Terminating (SIGTERM) 08:45:24.237937 --- ParallelTerminationStrategy: PID 15973 died... 08:45:24.257445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15973): Terminated: ok {rc=0} 08:45:24.302663 --- ParallelTerminationStrategy: PID 15974 died... 08:45:24.321550 run iperf3-srv_10.42.42.10(pid=15974): Terminated {rc=256} 08:45:24.366093 --- ParallelTerminationStrategy: PID 15975 died... 08:45:24.385015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15975): Terminated: ok {rc=0} 08:45:24.429327 --- ParallelTerminationStrategy: PID 15976 died... 08:45:24.448251 run iperf3-srv_10.42.42.10(pid=15976): Terminated {rc=256} 08:45:24.492865 --- ParallelTerminationStrategy: PID 15979 died... 08:45:24.512114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15979): Terminated: ok {rc=0} 08:45:24.556408 --- ParallelTerminationStrategy: PID 15982 died... 08:45:24.575186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15982): Terminated: ok {rc=0} 08:45:24.619458 --- ParallelTerminationStrategy: PID 15985 died... 08:45:24.638373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15985): Terminated: ok {rc=0} 08:45:24.723359 bus /gobi_0: Setting Powered False 08:45:25.822525 bus /gobi_0: Setting Powered False 08:45:26.942849 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200 iperf3.py ---------------------------------------------- 08:45:28.092085 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.103654 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:45:28.156121 tst iperf3.py: using LAC 20290 08:45:28.277430 tst iperf3.py: using RAC 145 08:45:28.400936 tst iperf3.py: using CellId 20290 08:45:28.523175 tst iperf3.py: using BVCI 20291 08:45:28.637691 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.648519 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.659154 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.670015 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.680504 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.691015 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.701752 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.712296 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:28.723001 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:28.839770 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:45:29.049036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:29.380319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15987): Launched 08:45:29.668099 run iperf3-srv_10.42.42.10(pid=15988): Launched 08:45:29.793058 tst iperf3.py:8: start network... 08:45:30.017661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:30.532911 run create_hlr_db(pid=15989): Launched 08:45:30.659829 bus /gobi_6: Setting Powered False 08:45:31.721276 run create_hlr_db(pid=15989): Terminated: ok {rc=0} 08:45:32.184621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15991): Launched 08:45:32.505731 run osmo-hlr_10.42.42.2(pid=15992): Launched 08:45:32.626479 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:33.175416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15994): Launched 08:45:33.487088 run osmo-stp_10.42.42.5(pid=15995): Launched 08:45:33.606322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:34.140111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15997): Launched 08:45:34.258232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:34.520094 run patchelf(pid=15998): Launched 08:45:34.692517 run osmo-stp_10.42.42.5(pid=15995): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15995)] 08:45:34.823671 run osmo-stp_10.42.42.5(pid=15995): stdout: | (launched: 2022-12-09_08:45:33.430407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:34.956208 run osmo-stp_10.42.42.5(pid=15995): stderr: | [0;m[38;5;43m20221209084533597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084533597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084533597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084533598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084533598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084533599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084533599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:35.088879 run osmo-stp_10.42.42.5(pid=15995): stdout: | (launched: 2022-12-09_08:45:33.430407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:35.215896 run osmo-stp_10.42.42.5(pid=15995): stderr: | [0;m[38;5;43m20221209084533597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084533597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084533597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084533598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084533598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084533599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084533599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:35.366950 run patchelf(pid=15998): Terminating (SIGINT) 08:45:35.540711 run patchelf(pid=15998): Terminated: ok {rc=0} 08:45:35.665917 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15995): Process ended prematurely: osmo-stp_10.42.42.5(pid=15995) [trial-2357↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15995)] [trial-2357↪gprs:trx-b200↪iperf3.py:8] 08:45:35.675371 tst iperf3.py:8: Test FAILED (7.6 sec) 08:45:35.702715 run osmo-hlr_10.42.42.2(pid=15992): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15992)] 08:45:35.750550 run osmo-hlr_10.42.42.2(pid=15992): stdout: | (launched: 2022-12-09_08:45:32.448756) 08:45:35.799886 run osmo-hlr_10.42.42.2(pid=15992): stderr: | [0;m[1;31m20221209084532623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084532623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084532623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084532623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084532624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084532624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084532636 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084532644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084532644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084532644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:35.849679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15987): Terminating (SIGTERM) 08:45:35.890056 run iperf3-srv_10.42.42.10(pid=15988): Terminating (SIGTERM) 08:45:35.930394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15991): Terminating (SIGTERM) 08:45:35.970848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15994): Terminating (SIGTERM) 08:45:36.011227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15997): Terminating (SIGTERM) 08:45:36.051897 --- ParallelTerminationStrategy: PID 15987 died... 08:45:36.071479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15987): Terminated: ok {rc=0} 08:45:36.116056 --- ParallelTerminationStrategy: PID 15988 died... 08:45:36.134658 run iperf3-srv_10.42.42.10(pid=15988): Terminated {rc=256} 08:45:36.178819 --- ParallelTerminationStrategy: PID 15991 died... 08:45:36.197619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15991): Terminated: ok {rc=0} 08:45:36.241512 --- ParallelTerminationStrategy: PID 15994 died... 08:45:36.260197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15994): Terminated: ok {rc=0} 08:45:36.304855 --- ParallelTerminationStrategy: PID 15997 died... 08:45:36.324307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15997): Terminated: ok {rc=0} 08:45:36.410997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 08:45:37.561168 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:37.572526 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:45:37.622389 tst iperf3m4.py: using LAC 20291 08:45:37.743775 tst iperf3m4.py: using RAC 146 08:45:37.867169 tst iperf3m4.py: using CellId 20291 08:45:37.990145 tst iperf3m4.py: using BVCI 20292 08:45:38.103993 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.114902 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.125500 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.136059 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.146562 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.157025 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.167669 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.178198 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:38.188727 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:38.306024 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:38.429666 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:38.550733 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:38.672306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:45:38.898029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:39.231689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15999): Launched 08:45:39.521143 run iperf3-srv_10.42.42.10(pid=16000): Launched 08:45:39.646826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:45:39.872444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:40.206672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16001): Launched 08:45:40.478495 run iperf3-srv_10.42.42.10(pid=16002): Launched 08:45:40.594936 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:45:40.802549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:41.114170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16003): Launched 08:45:41.384329 run iperf3-srv_10.42.42.10(pid=16004): Launched 08:45:41.503332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:45:41.710764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:42.022367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16005): Launched 08:45:42.291712 run iperf3-srv_10.42.42.10(pid=16006): Launched 08:45:42.407818 tst iperf3m4.py:8: start network... 08:45:42.615348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:43.101625 run create_hlr_db(pid=16007): Launched 08:45:43.227855 bus /gobi_6: Setting Powered False 08:45:44.290247 run create_hlr_db(pid=16007): Terminated: ok {rc=0} 08:45:44.742949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16009): Launched 08:45:45.077322 run osmo-hlr_10.42.42.2(pid=16010): Launched 08:45:45.204693 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:45.778329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16012): Launched 08:45:46.134333 run osmo-stp_10.42.42.5(pid=16013): Launched 08:45:46.382689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:47.029326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16015): Launched 08:45:47.167731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:47.449447 run patchelf(pid=16016): Launched 08:45:47.633903 run osmo-stp_10.42.42.5(pid=16013): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16013)] 08:45:47.774401 run osmo-stp_10.42.42.5(pid=16013): stdout: | (launched: 2022-12-09_08:45:46.074005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:47.917496 run osmo-stp_10.42.42.5(pid=16013): stderr: | [0;m[38;5;43m20221209084546354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084546354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084546355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084546355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084546356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084546356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084546356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:48.060032 run osmo-stp_10.42.42.5(pid=16013): stdout: | (launched: 2022-12-09_08:45:46.074005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:48.196525 run osmo-stp_10.42.42.5(pid=16013): stderr: | [0;m[38;5;43m20221209084546354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084546354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084546355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084546355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084546356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084546356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084546356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:48.358985 run patchelf(pid=16016): Terminating (SIGINT) 08:45:48.545262 run patchelf(pid=16016): Terminated: ok {rc=0} 08:45:48.679509 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16013): Process ended prematurely: osmo-stp_10.42.42.5(pid=16013) [trial-2357↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16013)] [trial-2357↪gprs:trx-b200↪iperf3m4.py:8] 08:45:48.690109 tst iperf3m4.py:8: Test FAILED (11.2 sec) 08:45:48.720153 run osmo-hlr_10.42.42.2(pid=16010): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16010)] 08:45:48.771348 run osmo-hlr_10.42.42.2(pid=16010): stdout: | (launched: 2022-12-09_08:45:45.017186) 08:45:48.824242 run osmo-hlr_10.42.42.2(pid=16010): stderr: | [0;m[1;31m20221209084545212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084545213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084545213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084545213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084545213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084545213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084545226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084545235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084545235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084545235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:48.877972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15999): Terminating (SIGTERM) 08:45:48.921313 run iperf3-srv_10.42.42.10(pid=16000): Terminating (SIGTERM) 08:45:48.964432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16001): Terminating (SIGTERM) 08:45:49.007596 run iperf3-srv_10.42.42.10(pid=16002): Terminating (SIGTERM) 08:45:49.050826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16003): Terminating (SIGTERM) 08:45:49.093844 run iperf3-srv_10.42.42.10(pid=16004): Terminating (SIGTERM) 08:45:49.136808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16005): Terminating (SIGTERM) 08:45:49.179852 run iperf3-srv_10.42.42.10(pid=16006): Terminating (SIGTERM) 08:45:49.222765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16009): Terminating (SIGTERM) 08:45:49.265832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16012): Terminating (SIGTERM) 08:45:49.308820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16015): Terminating (SIGTERM) 08:45:49.352245 --- ParallelTerminationStrategy: PID 15999 died... 08:45:49.372586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15999): Terminated: ok {rc=0} 08:45:49.420335 --- ParallelTerminationStrategy: PID 16000 died... 08:45:49.440319 run iperf3-srv_10.42.42.10(pid=16000): Terminated {rc=256} 08:45:49.488481 --- ParallelTerminationStrategy: PID 16001 died... 08:45:49.508500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16001): Terminated: ok {rc=0} 08:45:49.556216 --- ParallelTerminationStrategy: PID 16002 died... 08:45:49.576270 run iperf3-srv_10.42.42.10(pid=16002): Terminated {rc=256} 08:45:49.623600 --- ParallelTerminationStrategy: PID 16003 died... 08:45:49.643576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16003): Terminated: ok {rc=0} 08:45:49.691144 --- ParallelTerminationStrategy: PID 16004 died... 08:45:49.711057 run iperf3-srv_10.42.42.10(pid=16004): Terminated {rc=256} 08:45:49.758324 --- ParallelTerminationStrategy: PID 16005 died... 08:45:49.778356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16005): Terminated: ok {rc=0} 08:45:49.825394 --- ParallelTerminationStrategy: PID 16006 died... 08:45:49.845830 run iperf3-srv_10.42.42.10(pid=16006): Terminated {rc=256} 08:45:49.893642 --- ParallelTerminationStrategy: PID 16009 died... 08:45:49.913724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16009): Terminated: ok {rc=0} 08:45:49.961301 --- ParallelTerminationStrategy: PID 16012 died... 08:45:49.981385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16012): Terminated: ok {rc=0} 08:45:50.028937 --- ParallelTerminationStrategy: PID 16015 died... 08:45:50.049139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16015): Terminated: ok {rc=0} 08:45:50.139579 bus /gobi_4: Setting Powered False 08:45:51.241277 bus /gobi_4: Setting Powered False 08:45:52.359937 bus /gobi_1: Setting Powered False 08:45:53.459686 bus /gobi_1: Setting Powered False 08:45:54.578318 bus /gobi_0: Setting Powered False 08:45:55.676696 bus /gobi_0: Setting Powered False 08:45:56.798113 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200 ping.py ---------------------------------------------- 08:45:57.902949 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:57.914579 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:45:57.967976 tst ping.py: using LAC 20292 08:45:58.087905 tst ping.py: using RAC 147 08:45:58.209982 tst ping.py: using CellId 20292 08:45:58.330721 tst ping.py: using BVCI 20293 08:45:58.443004 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:58.453746 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:58.464345 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:58.474953 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:58.485458 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:58.495933 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:58.506586 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:45:58.517140 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:45:58.633627 tst ping.py:19: start network... 08:45:58.838388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:59.312627 run create_hlr_db(pid=16017): Launched 08:45:59.436472 bus /gobi_6: Setting Powered False 08:46:00.501083 run create_hlr_db(pid=16017): Terminated: ok {rc=0} 08:46:00.964520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16019): Launched 08:46:01.317276 run osmo-hlr_10.42.42.2(pid=16020): Launched 08:46:01.615216 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:02.285963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16022): Launched 08:46:02.625648 run osmo-stp_10.42.42.5(pid=16023): Launched 08:46:02.743427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:03.271068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16025): Launched 08:46:03.387773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:03.645961 run patchelf(pid=16026): Launched 08:46:03.816314 run osmo-stp_10.42.42.5(pid=16023): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] 08:46:03.946413 run osmo-stp_10.42.42.5(pid=16023): stdout: | (launched: 2022-12-09_08:46:02.568426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:04.077415 run osmo-stp_10.42.42.5(pid=16023): stderr: | [0;m[38;5;43m20221209084602739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084602739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084602740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084602740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084602740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084602740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084602741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:04.208594 run osmo-stp_10.42.42.5(pid=16023): stdout: | (launched: 2022-12-09_08:46:02.568426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:04.333856 run osmo-stp_10.42.42.5(pid=16023): stderr: | [0;m[38;5;43m20221209084602739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084602739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084602740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084602740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084602740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084602740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084602741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:04.482639 run patchelf(pid=16026): Terminating (SIGINT) 08:46:04.653651 run patchelf(pid=16026): Terminated: ok {rc=0} 08:46:04.776702 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16023): Process ended prematurely: osmo-stp_10.42.42.5(pid=16023) [trial-2357↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] [trial-2357↪gprs:trx-b200↪ping.py:22] 08:46:04.785811 tst ping.py:22: Test FAILED (6.9 sec) 08:46:04.812858 run osmo-hlr_10.42.42.2(pid=16020): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16020)] 08:46:04.860676 run osmo-hlr_10.42.42.2(pid=16020): stdout: | (launched: 2022-12-09_08:46:01.258273) 08:46:04.910697 run osmo-hlr_10.42.42.2(pid=16020): stderr: | [0;m[1;31m20221209084601654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084601654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084601654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084601654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084601654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084601654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084601670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084601692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084601693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084601693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:04.960682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16019): Terminating (SIGTERM) 08:46:05.000761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16022): Terminating (SIGTERM) 08:46:05.040978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16025): Terminating (SIGTERM) 08:46:05.081191 --- ParallelTerminationStrategy: PID 16019 died... 08:46:05.100447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16019): Terminated: ok {rc=0} 08:46:05.144805 --- ParallelTerminationStrategy: PID 16022 died... 08:46:05.163853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16022): Terminated: ok {rc=0} 08:46:05.208033 --- ParallelTerminationStrategy: PID 16025 died... 08:46:05.226790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16025): Terminated: ok {rc=0} 08:46:05.313429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 08:46:06.401974 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:06.413708 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:46:06.465115 tst ping_idle_ping.py: using LAC 20293 08:46:06.587473 tst ping_idle_ping.py: using RAC 148 08:46:06.708832 tst ping_idle_ping.py: using CellId 20293 08:46:06.828466 tst ping_idle_ping.py: using BVCI 20294 08:46:06.941282 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:06.951989 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:06.962743 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:06.973372 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:06.983857 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:06.994421 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:07.005114 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:46:07.015776 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:46:07.131817 tst ping_idle_ping.py:24: start network... 08:46:07.336387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:07.814107 run create_hlr_db(pid=16027): Launched 08:46:07.941613 bus /gobi_6: Setting Powered False 08:46:09.003138 run create_hlr_db(pid=16027): Terminated: ok {rc=0} 08:46:09.430407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16029): Launched 08:46:09.737675 run osmo-hlr_10.42.42.2(pid=16030): Launched 08:46:09.854355 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:10.379403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16032): Launched 08:46:10.685035 run osmo-stp_10.42.42.5(pid=16033): Launched 08:46:10.802861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:11.332581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16035): Launched 08:46:11.449588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:11.708666 run patchelf(pid=16036): Launched 08:46:11.879581 run osmo-stp_10.42.42.5(pid=16033): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16033)] 08:46:12.009552 run osmo-stp_10.42.42.5(pid=16033): stdout: | (launched: 2022-12-09_08:46:10.628616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:12.141138 run osmo-stp_10.42.42.5(pid=16033): stderr: | [0;m[38;5;43m20221209084610800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084610800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084610800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084610800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084610801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084610801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084610801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:12.272320 run osmo-stp_10.42.42.5(pid=16033): stdout: | (launched: 2022-12-09_08:46:10.628616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:12.397951 run osmo-stp_10.42.42.5(pid=16033): stderr: | [0;m[38;5;43m20221209084610800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084610800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084610800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084610800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084610801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084610801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084610801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:12.547232 run patchelf(pid=16036): Terminating (SIGINT) 08:46:12.718875 run patchelf(pid=16036): Terminated: ok {rc=0} 08:46:12.842403 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16033): Process ended prematurely: osmo-stp_10.42.42.5(pid=16033) [trial-2357↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16033)] [trial-2357↪gprs:trx-b200↪ping_idle_ping.py:27] 08:46:12.851274 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:46:12.878304 run osmo-hlr_10.42.42.2(pid=16030): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16030)] 08:46:12.926743 run osmo-hlr_10.42.42.2(pid=16030): stdout: | (launched: 2022-12-09_08:46:09.681496) 08:46:12.976822 run osmo-hlr_10.42.42.2(pid=16030): stderr: | [0;m[1;31m20221209084609856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084609856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084609856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084609856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084609856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084609856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084609868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084609877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084609877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084609878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:13.027352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16029): Terminating (SIGTERM) 08:46:13.067610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16032): Terminating (SIGTERM) 08:46:13.107745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16035): Terminating (SIGTERM) 08:46:13.148337 --- ParallelTerminationStrategy: PID 16029 died... 08:46:13.167828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16029): Terminated: ok {rc=0} 08:46:13.212494 --- ParallelTerminationStrategy: PID 16032 died... 08:46:13.231546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16032): Terminated: ok {rc=0} 08:46:13.275835 --- ParallelTerminationStrategy: PID 16035 died... 08:46:13.294743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16035): Terminated: ok {rc=0} 08:46:13.382521 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 08:46:14.700264 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:46:14.706946 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:46:14.742673 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:46:14.783736 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:46:14.873177 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:46:14.908154 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:46:14.948628 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:46:15.547617 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:46:15.601963 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:15.613570 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:46:15.664762 tst cs_paging_gprs_active.py: using LAC 20294 08:46:15.795795 tst cs_paging_gprs_active.py: using RAC 149 08:46:15.958153 tst cs_paging_gprs_active.py: using CellId 20294 08:46:16.119595 tst cs_paging_gprs_active.py: using BVCI 20295 08:46:16.247382 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.259949 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.272269 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.284935 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.298664 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.311715 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.324860 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.340092 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:16.354028 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:16.478004 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:16.628465 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:46:16.865841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:17.205019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16040): Launched 08:46:17.504276 run iperf3-srv_10.42.42.10(pid=16041): Launched 08:46:17.630007 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:46:17.855848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:18.190750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16042): Launched 08:46:18.480492 run iperf3-srv_10.42.42.10(pid=16043): Launched 08:46:18.605019 tst cs_paging_gprs_active.py:38: start network... 08:46:18.829622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:19.345637 run create_hlr_db(pid=16044): Launched 08:46:19.474185 bus /gobi_6: Setting Powered False 08:46:20.539618 run create_hlr_db(pid=16044): Terminated: ok {rc=0} 08:46:21.000288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16046): Launched 08:46:21.332090 run osmo-hlr_10.42.42.2(pid=16047): Launched 08:46:21.459489 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:22.034037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16049): Launched 08:46:22.366881 run osmo-stp_10.42.42.5(pid=16050): Launched 08:46:22.495546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:23.068560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16052): Launched 08:46:23.195188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:23.475192 run patchelf(pid=16053): Launched 08:46:23.660646 run osmo-stp_10.42.42.5(pid=16050): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16050)] 08:46:23.801375 run osmo-stp_10.42.42.5(pid=16050): stdout: | (launched: 2022-12-09_08:46:22.306678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:23.944234 run osmo-stp_10.42.42.5(pid=16050): stderr: | [0;m[38;5;43m20221209084622495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084622495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084622496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084622496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084622496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084622496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084622497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:24.086449 run osmo-stp_10.42.42.5(pid=16050): stdout: | (launched: 2022-12-09_08:46:22.306678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:24.223060 run osmo-stp_10.42.42.5(pid=16050): stderr: | [0;m[38;5;43m20221209084622495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084622495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084622496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084622496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084622496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084622496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084622497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:24.384892 run patchelf(pid=16053): Terminating (SIGINT) 08:46:24.571169 run patchelf(pid=16053): Terminated: ok {rc=0} 08:46:24.705713 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16050): Process ended prematurely: osmo-stp_10.42.42.5(pid=16050) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16050)] [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:46:24.715985 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 08:46:24.744779 run osmo-hlr_10.42.42.2(pid=16047): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16047)] 08:46:24.795448 run osmo-hlr_10.42.42.2(pid=16047): stdout: | (launched: 2022-12-09_08:46:21.271789) 08:46:24.847794 run osmo-hlr_10.42.42.2(pid=16047): stderr: | [0;m[1;31m20221209084621467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084621467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084621467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084621467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084621467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084621467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084621480 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084621489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084621489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084621489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:24.901153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16040): Terminating (SIGTERM) 08:46:24.943894 run iperf3-srv_10.42.42.10(pid=16041): Terminating (SIGTERM) 08:46:24.986308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16042): Terminating (SIGTERM) 08:46:25.028813 run iperf3-srv_10.42.42.10(pid=16043): Terminating (SIGTERM) 08:46:25.071481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16046): Terminating (SIGTERM) 08:46:25.114001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16049): Terminating (SIGTERM) 08:46:25.156179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16052): Terminating (SIGTERM) 08:46:25.198683 --- ParallelTerminationStrategy: PID 16040 died... 08:46:25.219214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16040): Terminated: ok {rc=0} 08:46:25.266027 --- ParallelTerminationStrategy: PID 16041 died... 08:46:25.285691 run iperf3-srv_10.42.42.10(pid=16041): Terminated {rc=256} 08:46:25.332197 --- ParallelTerminationStrategy: PID 16042 died... 08:46:25.351928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16042): Terminated: ok {rc=0} 08:46:25.398432 --- ParallelTerminationStrategy: PID 16043 died... 08:46:25.418080 run iperf3-srv_10.42.42.10(pid=16043): Terminated {rc=256} 08:46:25.464506 --- ParallelTerminationStrategy: PID 16046 died... 08:46:25.484206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16046): Terminated: ok {rc=0} 08:46:25.530942 --- ParallelTerminationStrategy: PID 16049 died... 08:46:25.550650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16049): Terminated: ok {rc=0} 08:46:25.597201 --- ParallelTerminationStrategy: PID 16052 died... 08:46:25.616727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16052): Terminated: ok {rc=0} 08:46:25.705882 bus /gobi_0: Setting Powered False 08:46:26.805878 bus /gobi_0: Setting Powered False 08:46:27.925177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:46:29.073705 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.085606 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:46:29.141172 tst iperf3.py: using LAC 20295 08:46:29.265167 tst iperf3.py: using RAC 150 08:46:29.393841 tst iperf3.py: using CellId 20295 08:46:29.516233 tst iperf3.py: using BVCI 20296 08:46:29.629792 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.640932 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.651949 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.663599 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.675460 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.687186 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.698908 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.710314 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:29.721696 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:29.845306 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:46:30.071490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:30.405265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16054): Launched 08:46:30.696036 run iperf3-srv_10.42.42.10(pid=16055): Launched 08:46:30.822378 tst iperf3.py:8: start network... 08:46:31.052127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:31.580120 run create_hlr_db(pid=16056): Launched 08:46:31.763340 bus /gobi_6: Setting Powered False 08:46:32.828158 run create_hlr_db(pid=16056): Terminated: ok {rc=0} 08:46:33.277268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16058): Launched 08:46:33.586803 run osmo-hlr_10.42.42.2(pid=16059): Launched 08:46:33.705264 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:34.252196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16061): Launched 08:46:34.561701 run osmo-stp_10.42.42.5(pid=16062): Launched 08:46:34.680885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:35.214835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16064): Launched 08:46:35.333120 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:35.594380 run patchelf(pid=16065): Launched 08:46:35.768116 run osmo-stp_10.42.42.5(pid=16062): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16062)] 08:46:35.900163 run osmo-stp_10.42.42.5(pid=16062): stdout: | (launched: 2022-12-09_08:46:34.505125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:36.032852 run osmo-stp_10.42.42.5(pid=16062): stderr: | [0;m[38;5;43m20221209084634673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084634673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084634673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084634674 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084634674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084634674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084634674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:36.165906 run osmo-stp_10.42.42.5(pid=16062): stdout: | (launched: 2022-12-09_08:46:34.505125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:36.292855 run osmo-stp_10.42.42.5(pid=16062): stderr: | [0;m[38;5;43m20221209084634673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084634673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084634673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084634674 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084634674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084634674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084634674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:36.444006 run patchelf(pid=16065): Terminating (SIGINT) 08:46:36.618051 run patchelf(pid=16065): Terminated: ok {rc=0} 08:46:36.742928 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16062): Process ended prematurely: osmo-stp_10.42.42.5(pid=16062) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16062)] [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 08:46:36.752386 tst iperf3.py:8: Test FAILED (7.7 sec) 08:46:36.779687 run osmo-hlr_10.42.42.2(pid=16059): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16059)] 08:46:36.827588 run osmo-hlr_10.42.42.2(pid=16059): stdout: | (launched: 2022-12-09_08:46:33.530482) 08:46:36.877130 run osmo-hlr_10.42.42.2(pid=16059): stderr: | [0;m[1;31m20221209084633703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084633703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084633703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084633703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084633703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084633703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084633715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084633723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084633724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084633724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:36.927164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16054): Terminating (SIGTERM) 08:46:36.967248 run iperf3-srv_10.42.42.10(pid=16055): Terminating (SIGTERM) 08:46:37.007299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16058): Terminating (SIGTERM) 08:46:37.047476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16061): Terminating (SIGTERM) 08:46:37.087615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16064): Terminating (SIGTERM) 08:46:37.128007 --- ParallelTerminationStrategy: PID 16054 died... 08:46:37.147241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16054): Terminated: ok {rc=0} 08:46:37.191837 --- ParallelTerminationStrategy: PID 16055 died... 08:46:37.210755 run iperf3-srv_10.42.42.10(pid=16055): Terminated {rc=256} 08:46:37.255134 --- ParallelTerminationStrategy: PID 16058 died... 08:46:37.274008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16058): Terminated: ok {rc=0} 08:46:37.317890 --- ParallelTerminationStrategy: PID 16061 died... 08:46:37.336701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16061): Terminated: ok {rc=0} 08:46:37.380657 --- ParallelTerminationStrategy: PID 16064 died... 08:46:37.399632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16064): Terminated: ok {rc=0} 08:46:37.484640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:46:38.636607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:38.649035 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:46:38.703420 tst iperf3m4.py: using LAC 20296 08:46:38.835407 tst iperf3m4.py: using RAC 151 08:46:38.965431 tst iperf3m4.py: using CellId 20296 08:46:39.089323 tst iperf3m4.py: using BVCI 20297 08:46:39.202722 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.213793 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.224692 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.236008 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.247409 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.258909 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.270457 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.281732 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:39.293161 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:39.415243 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:39.537048 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:39.660127 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:39.780888 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:46:39.991596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:40.304364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16066): Launched 08:46:40.575546 run iperf3-srv_10.42.42.10(pid=16067): Launched 08:46:40.692699 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:46:40.900491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:41.211387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16068): Launched 08:46:41.480837 run iperf3-srv_10.42.42.10(pid=16069): Launched 08:46:41.596932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:46:41.804440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:42.117056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16070): Launched 08:46:42.386887 run iperf3-srv_10.42.42.10(pid=16071): Launched 08:46:42.503204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:46:42.710746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:43.021986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16072): Launched 08:46:43.293183 run iperf3-srv_10.42.42.10(pid=16073): Launched 08:46:43.411112 tst iperf3m4.py:8: start network... 08:46:43.618266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:44.101191 run create_hlr_db(pid=16074): Launched 08:46:44.226834 bus /gobi_6: Setting Powered False 08:46:45.288023 run create_hlr_db(pid=16074): Terminated: ok {rc=0} 08:46:45.741544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16076): Launched 08:46:46.103362 run osmo-hlr_10.42.42.2(pid=16077): Launched 08:46:46.434185 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:47.030629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16079): Launched 08:46:47.351251 run osmo-stp_10.42.42.5(pid=16080): Launched 08:46:47.487740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:48.036125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16082): Launched 08:46:48.155897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:48.417638 run patchelf(pid=16083): Launched 08:46:48.589209 run osmo-stp_10.42.42.5(pid=16080): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16080)] 08:46:48.720202 run osmo-stp_10.42.42.5(pid=16080): stdout: | (launched: 2022-12-09_08:46:47.294333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:48.852883 run osmo-stp_10.42.42.5(pid=16080): stderr: | [0;m[38;5;43m20221209084647486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084647487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084647487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084647487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084647488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084647488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084647488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:48.985347 run osmo-stp_10.42.42.5(pid=16080): stdout: | (launched: 2022-12-09_08:46:47.294333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:49.112199 run osmo-stp_10.42.42.5(pid=16080): stderr: | [0;m[38;5;43m20221209084647486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084647487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084647487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084647487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084647488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084647488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084647488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:49.262722 run patchelf(pid=16083): Terminating (SIGINT) 08:46:49.436623 run patchelf(pid=16083): Terminated: ok {rc=0} 08:46:49.561957 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16080): Process ended prematurely: osmo-stp_10.42.42.5(pid=16080) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16080)] [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 08:46:49.571494 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:46:49.599258 run osmo-hlr_10.42.42.2(pid=16077): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16077)] 08:46:49.647437 run osmo-hlr_10.42.42.2(pid=16077): stdout: | (launched: 2022-12-09_08:46:46.044045) 08:46:49.697127 run osmo-hlr_10.42.42.2(pid=16077): stderr: | [0;m[1;31m20221209084646418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084646418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084646418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084646418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084646418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084646418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084646444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084646456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084646461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084646461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:49.747275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16066): Terminating (SIGTERM) 08:46:49.787883 run iperf3-srv_10.42.42.10(pid=16067): Terminating (SIGTERM) 08:46:49.828263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16068): Terminating (SIGTERM) 08:46:49.868938 run iperf3-srv_10.42.42.10(pid=16069): Terminating (SIGTERM) 08:46:49.909235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16070): Terminating (SIGTERM) 08:46:49.950090 run iperf3-srv_10.42.42.10(pid=16071): Terminating (SIGTERM) 08:46:49.990536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16072): Terminating (SIGTERM) 08:46:50.030837 run iperf3-srv_10.42.42.10(pid=16073): Terminating (SIGTERM) 08:46:50.071028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16076): Terminating (SIGTERM) 08:46:50.111374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16079): Terminating (SIGTERM) 08:46:50.151756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16082): Terminating (SIGTERM) 08:46:50.193034 --- ParallelTerminationStrategy: PID 16066 died... 08:46:50.212349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16066): Terminated: ok {rc=0} 08:46:50.257042 --- ParallelTerminationStrategy: PID 16067 died... 08:46:50.275828 run iperf3-srv_10.42.42.10(pid=16067): Terminated {rc=256} 08:46:50.320156 --- ParallelTerminationStrategy: PID 16068 died... 08:46:50.339176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16068): Terminated: ok {rc=0} 08:46:50.383632 --- ParallelTerminationStrategy: PID 16069 died... 08:46:50.402626 run iperf3-srv_10.42.42.10(pid=16069): Terminated {rc=256} 08:46:50.446886 --- ParallelTerminationStrategy: PID 16070 died... 08:46:50.465677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16070): Terminated: ok {rc=0} 08:46:50.510134 --- ParallelTerminationStrategy: PID 16071 died... 08:46:50.529157 run iperf3-srv_10.42.42.10(pid=16071): Terminated {rc=256} 08:46:50.573627 --- ParallelTerminationStrategy: PID 16072 died... 08:46:50.592626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16072): Terminated: ok {rc=0} 08:46:50.637483 --- ParallelTerminationStrategy: PID 16073 died... 08:46:50.656574 run iperf3-srv_10.42.42.10(pid=16073): Terminated {rc=256} 08:46:50.701157 --- ParallelTerminationStrategy: PID 16076 died... 08:46:50.719934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16076): Terminated: ok {rc=0} 08:46:50.764164 --- ParallelTerminationStrategy: PID 16079 died... 08:46:50.783048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16079): Terminated: ok {rc=0} 08:46:50.827290 --- ParallelTerminationStrategy: PID 16082 died... 08:46:50.846193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16082): Terminated: ok {rc=0} 08:46:50.933257 bus /gobi_4: Setting Powered False 08:46:52.035557 bus /gobi_4: Setting Powered False 08:46:53.152362 bus /gobi_1: Setting Powered False 08:46:54.253468 bus /gobi_1: Setting Powered False 08:46:55.369263 bus /gobi_0: Setting Powered False 08:46:56.469592 bus /gobi_0: Setting Powered False 08:46:57.585350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 08:46:58.689359 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:58.700918 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:46:58.753317 tst ping.py: using LAC 20297 08:46:58.875027 tst ping.py: using RAC 152 08:46:58.996579 tst ping.py: using CellId 20297 08:46:59.116424 tst ping.py: using BVCI 20298 08:46:59.228725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:59.240346 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:59.251308 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:59.262323 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:59.273126 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:59.284307 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:59.295345 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:46:59.306277 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:46:59.428677 tst ping.py:19: start network... 08:46:59.650447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:00.156737 run create_hlr_db(pid=16085): Launched 08:47:00.284074 bus /gobi_6: Setting Powered False 08:47:01.349546 run create_hlr_db(pid=16085): Terminated: ok {rc=0} 08:47:01.848199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Launched 08:47:02.193538 run osmo-hlr_10.42.42.2(pid=16088): Launched 08:47:02.320259 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:02.891726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Launched 08:47:03.196535 run osmo-stp_10.42.42.5(pid=16091): Launched 08:47:03.312588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:03.838057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16093): Launched 08:47:03.956321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:04.214431 run patchelf(pid=16094): Launched 08:47:04.385622 run osmo-stp_10.42.42.5(pid=16091): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] 08:47:04.514424 run osmo-stp_10.42.42.5(pid=16091): stdout: | (launched: 2022-12-09_08:47:03.140403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:04.644699 run osmo-stp_10.42.42.5(pid=16091): stderr: | [0;m[38;5;43m20221209084703309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084703309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084703309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084703310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084703310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084703310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084703310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:04.774964 run osmo-stp_10.42.42.5(pid=16091): stdout: | (launched: 2022-12-09_08:47:03.140403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:04.899733 run osmo-stp_10.42.42.5(pid=16091): stderr: | [0;m[38;5;43m20221209084703309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084703309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084703309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084703310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084703310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084703310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084703310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:05.047599 run patchelf(pid=16094): Terminating (SIGINT) 08:47:05.217291 run patchelf(pid=16094): Terminated: ok {rc=0} 08:47:05.340053 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16091): Process ended prematurely: osmo-stp_10.42.42.5(pid=16091) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 08:47:05.349188 tst ping.py:22: Test FAILED (6.7 sec) 08:47:05.376180 run osmo-hlr_10.42.42.2(pid=16088): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16088)] 08:47:05.424282 run osmo-hlr_10.42.42.2(pid=16088): stdout: | (launched: 2022-12-09_08:47:02.133161) 08:47:05.473948 run osmo-hlr_10.42.42.2(pid=16088): stderr: | [0;m[1;31m20221209084702329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084702329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084702329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084702329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084702329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084702329 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084702346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084702356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084702356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084702356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:05.524526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Terminating (SIGTERM) 08:47:05.564568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Terminating (SIGTERM) 08:47:05.604600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16093): Terminating (SIGTERM) 08:47:05.645227 --- ParallelTerminationStrategy: PID 16087 died... 08:47:05.664448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16087): Terminated: ok {rc=0} 08:47:05.708796 --- ParallelTerminationStrategy: PID 16090 died... 08:47:05.727664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16090): Terminated: ok {rc=0} 08:47:05.771945 --- ParallelTerminationStrategy: PID 16093 died... 08:47:05.790727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16093): Terminated: ok {rc=0} 08:47:05.877479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:47:06.967918 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:06.979674 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:47:07.031534 tst ping_idle_ping.py: using LAC 20298 08:47:07.151380 tst ping_idle_ping.py: using RAC 153 08:47:07.270599 tst ping_idle_ping.py: using CellId 20298 08:47:07.391547 tst ping_idle_ping.py: using BVCI 20299 08:47:07.512281 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:07.524094 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:07.535596 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:07.547845 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:07.560127 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:07.572167 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:07.584412 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:47:07.596548 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:47:07.716068 tst ping_idle_ping.py:24: start network... 08:47:07.920591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:08.396599 run create_hlr_db(pid=16095): Launched 08:47:08.522370 bus /gobi_6: Setting Powered False 08:47:09.583078 run create_hlr_db(pid=16095): Terminated: ok {rc=0} 08:47:10.029950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16097): Launched 08:47:10.358136 run osmo-hlr_10.42.42.2(pid=16098): Launched 08:47:10.485150 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:11.053106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16100): Launched 08:47:11.382243 run osmo-stp_10.42.42.5(pid=16101): Launched 08:47:11.507331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:12.073582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16103): Launched 08:47:12.200028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:12.476728 run patchelf(pid=16104): Launched 08:47:12.658418 run osmo-stp_10.42.42.5(pid=16101): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16101)] 08:47:12.797249 run osmo-stp_10.42.42.5(pid=16101): stdout: | (launched: 2022-12-09_08:47:11.322504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:12.937860 run osmo-stp_10.42.42.5(pid=16101): stderr: | [0;m[38;5;43m20221209084711512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084711512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084711512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084711513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084711513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084711513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084711513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:13.078531 run osmo-stp_10.42.42.5(pid=16101): stdout: | (launched: 2022-12-09_08:47:11.322504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:13.213212 run osmo-stp_10.42.42.5(pid=16101): stderr: | [0;m[38;5;43m20221209084711512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084711512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084711512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084711513 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084711513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084711513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084711513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:13.372633 run patchelf(pid=16104): Terminating (SIGINT) 08:47:13.556315 run patchelf(pid=16104): Terminated: ok {rc=0} 08:47:13.688532 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16101): Process ended prematurely: osmo-stp_10.42.42.5(pid=16101) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16101)] [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 08:47:13.698278 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:47:13.727255 run osmo-hlr_10.42.42.2(pid=16098): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16098)] 08:47:13.778667 run osmo-hlr_10.42.42.2(pid=16098): stdout: | (launched: 2022-12-09_08:47:10.298540) 08:47:13.831364 run osmo-hlr_10.42.42.2(pid=16098): stderr: | [0;m[1;31m20221209084710494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084710494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084710494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084710494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084710494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084710494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084710506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084710514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084710515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084710515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:13.884569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16097): Terminating (SIGTERM) 08:47:13.927756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16100): Terminating (SIGTERM) 08:47:13.970647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16103): Terminating (SIGTERM) 08:47:14.014673 --- ParallelTerminationStrategy: PID 16097 died... 08:47:14.035095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16097): Terminated: ok {rc=0} 08:47:14.083094 --- ParallelTerminationStrategy: PID 16100 died... 08:47:14.103167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16100): Terminated: ok {rc=0} 08:47:14.150756 --- ParallelTerminationStrategy: PID 16103 died... 08:47:14.170776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16103): Terminated: ok {rc=0} 08:47:14.259738 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:47:15.580637 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:47:15.588405 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:47:15.623370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:47:15.662432 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:47:15.750072 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:47:15.783562 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:47:15.822319 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:47:16.461654 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:47:16.531194 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:16.545579 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:47:16.629089 tst cs_paging_gprs_active.py: using LAC 20299 08:47:16.786849 tst cs_paging_gprs_active.py: using RAC 154 08:47:16.911546 tst cs_paging_gprs_active.py: using CellId 20299 08:47:17.083818 tst cs_paging_gprs_active.py: using BVCI 20300 08:47:17.239170 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.251940 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.264082 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.276176 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.287908 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.299868 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.312632 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.326779 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:17.338496 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:47:17.461596 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:47:17.582717 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:47:17.792610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:18.104593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16109): Launched 08:47:18.375886 run iperf3-srv_10.42.42.10(pid=16110): Launched 08:47:18.492006 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:47:18.700485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:19.011726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16111): Launched 08:47:19.281992 run iperf3-srv_10.42.42.10(pid=16112): Launched 08:47:19.400406 tst cs_paging_gprs_active.py:38: start network... 08:47:19.608745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:20.091442 run create_hlr_db(pid=16113): Launched 08:47:20.219463 bus /gobi_6: Setting Powered False 08:47:21.280805 run create_hlr_db(pid=16113): Terminated: ok {rc=0} 08:47:21.734610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16115): Launched 08:47:22.069663 run osmo-hlr_10.42.42.2(pid=16116): Launched 08:47:22.197797 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:22.772184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16118): Launched 08:47:23.104777 run osmo-stp_10.42.42.5(pid=16119): Launched 08:47:23.231468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:23.805348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16121): Launched 08:47:23.932420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:24.213601 run patchelf(pid=16122): Launched 08:47:24.398173 run osmo-stp_10.42.42.5(pid=16119): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16119)] 08:47:24.538436 run osmo-stp_10.42.42.5(pid=16119): stdout: | (launched: 2022-12-09_08:47:23.044740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:24.680501 run osmo-stp_10.42.42.5(pid=16119): stderr: | [0;m[38;5;43m20221209084723235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084723235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084723235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084723235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084723236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084723236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084723236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:24.822369 run osmo-stp_10.42.42.5(pid=16119): stdout: | (launched: 2022-12-09_08:47:23.044740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:24.958863 run osmo-stp_10.42.42.5(pid=16119): stderr: | [0;m[38;5;43m20221209084723235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084723235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084723235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084723235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084723236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084723236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084723236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:25.120209 run patchelf(pid=16122): Terminating (SIGINT) 08:47:25.305673 run patchelf(pid=16122): Terminated: ok {rc=0} 08:47:25.439596 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16119): Process ended prematurely: osmo-stp_10.42.42.5(pid=16119) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16119)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:47:25.450233 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:47:25.479668 run osmo-hlr_10.42.42.2(pid=16116): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16116)] 08:47:25.530571 run osmo-hlr_10.42.42.2(pid=16116): stdout: | (launched: 2022-12-09_08:47:22.009403) 08:47:25.583471 run osmo-hlr_10.42.42.2(pid=16116): stderr: | [0;m[1;31m20221209084722206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084722206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084722206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084722206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084722207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084722207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084722219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084722228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084722229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084722229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:25.636681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16109): Terminating (SIGTERM) 08:47:25.679709 run iperf3-srv_10.42.42.10(pid=16110): Terminating (SIGTERM) 08:47:25.722584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16111): Terminating (SIGTERM) 08:47:25.765528 run iperf3-srv_10.42.42.10(pid=16112): Terminating (SIGTERM) 08:47:25.808425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16115): Terminating (SIGTERM) 08:47:25.851450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16118): Terminating (SIGTERM) 08:47:25.894481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16121): Terminating (SIGTERM) 08:47:25.938180 --- ParallelTerminationStrategy: PID 16109 died... 08:47:25.958615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16109): Terminated: ok {rc=0} 08:47:26.006380 --- ParallelTerminationStrategy: PID 16110 died... 08:47:26.026277 run iperf3-srv_10.42.42.10(pid=16110): Terminated {rc=256} 08:47:26.073634 --- ParallelTerminationStrategy: PID 16111 died... 08:47:26.093740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16111): Terminated: ok {rc=0} 08:47:26.141155 --- ParallelTerminationStrategy: PID 16112 died... 08:47:26.161091 run iperf3-srv_10.42.42.10(pid=16112): Terminated {rc=256} 08:47:26.208186 --- ParallelTerminationStrategy: PID 16115 died... 08:47:26.228119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16115): Terminated: ok {rc=0} 08:47:26.275480 --- ParallelTerminationStrategy: PID 16118 died... 08:47:26.295380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16118): Terminated: ok {rc=0} 08:47:26.342676 --- ParallelTerminationStrategy: PID 16121 died... 08:47:26.362528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16121): Terminated: ok {rc=0} 08:47:26.451820 bus /gobi_0: Setting Powered False 08:47:27.553055 bus /gobi_0: Setting Powered False 08:47:28.670531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:47:29.822816 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:29.835250 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:47:29.911163 tst iperf3.py: using LAC 20300 08:47:30.040757 tst iperf3.py: using RAC 155 08:47:30.170332 tst iperf3.py: using CellId 20300 08:47:30.299909 tst iperf3.py: using BVCI 20301 08:47:30.420013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.431601 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.443033 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.454667 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.466175 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.477750 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.489409 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.500744 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:30.512559 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:47:30.632406 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:47:30.848496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:31.203505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16123): Launched 08:47:31.522567 run iperf3-srv_10.42.42.10(pid=16124): Launched 08:47:31.648898 tst iperf3.py:8: start network... 08:47:31.860664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:32.351528 run create_hlr_db(pid=16125): Launched 08:47:32.479246 bus /gobi_6: Setting Powered False 08:47:33.541434 run create_hlr_db(pid=16125): Terminated: ok {rc=0} 08:47:33.972280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Launched 08:47:34.282558 run osmo-hlr_10.42.42.2(pid=16128): Launched 08:47:34.402328 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:34.953623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Launched 08:47:35.262931 run osmo-stp_10.42.42.5(pid=16131): Launched 08:47:35.381274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:35.918325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16134): Launched 08:47:36.036505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:36.299676 run patchelf(pid=16135): Launched 08:47:36.472146 run osmo-stp_10.42.42.5(pid=16131): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] 08:47:36.603383 run osmo-stp_10.42.42.5(pid=16131): stdout: | (launched: 2022-12-09_08:47:35.206507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:36.736345 run osmo-stp_10.42.42.5(pid=16131): stderr: | [0;m[38;5;43m20221209084735374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084735374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084735375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084735375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084735375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084735376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084735376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:36.869259 run osmo-stp_10.42.42.5(pid=16131): stdout: | (launched: 2022-12-09_08:47:35.206507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:36.996841 run osmo-stp_10.42.42.5(pid=16131): stderr: | [0;m[38;5;43m20221209084735374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084735374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084735375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084735375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084735375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084735376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084735376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:37.147954 run patchelf(pid=16135): Terminating (SIGINT) 08:47:37.322358 run patchelf(pid=16135): Terminated: ok {rc=0} 08:47:37.447823 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16131): Process ended prematurely: osmo-stp_10.42.42.5(pid=16131) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 08:47:37.457402 tst iperf3.py:8: Test FAILED (7.7 sec) 08:47:37.484837 run osmo-hlr_10.42.42.2(pid=16128): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16128)] 08:47:37.533138 run osmo-hlr_10.42.42.2(pid=16128): stdout: | (launched: 2022-12-09_08:47:34.226035) 08:47:37.583117 run osmo-hlr_10.42.42.2(pid=16128): stderr: | [0;m[1;31m20221209084734400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084734400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084734400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084734400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084734400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084734400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084734412 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084734420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084734420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084734420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:37.633893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16123): Terminating (SIGTERM) 08:47:37.674222 run iperf3-srv_10.42.42.10(pid=16124): Terminating (SIGTERM) 08:47:37.714374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Terminating (SIGTERM) 08:47:37.754517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Terminating (SIGTERM) 08:47:37.794519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16134): Terminating (SIGTERM) 08:47:37.835152 --- ParallelTerminationStrategy: PID 16123 died... 08:47:37.854478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16123): Terminated: ok {rc=0} 08:47:37.899506 --- ParallelTerminationStrategy: PID 16124 died... 08:47:37.918346 run iperf3-srv_10.42.42.10(pid=16124): Terminated {rc=256} 08:47:37.962656 --- ParallelTerminationStrategy: PID 16127 died... 08:47:37.981441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Terminated: ok {rc=0} 08:47:38.025637 --- ParallelTerminationStrategy: PID 16130 died... 08:47:38.044602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Terminated: ok {rc=0} 08:47:38.088751 --- ParallelTerminationStrategy: PID 16134 died... 08:47:38.107668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16134): Terminated: ok {rc=0} 08:47:38.192113 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:47:39.343842 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.356204 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:47:39.431325 tst iperf3m4.py: using LAC 20301 08:47:39.554799 tst iperf3m4.py: using RAC 156 08:47:39.678727 tst iperf3m4.py: using CellId 20301 08:47:39.802420 tst iperf3m4.py: using BVCI 20302 08:47:39.914719 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.926056 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.937069 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.949176 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.959987 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.970871 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.981964 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:39.992740 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:40.003782 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:47:40.127081 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:47:40.252750 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:47:40.373444 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:47:40.497360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:47:40.723059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:41.057616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16136): Launched 08:47:41.348112 run iperf3-srv_10.42.42.10(pid=16137): Launched 08:47:41.474399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:47:41.700238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:42.035115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16138): Launched 08:47:42.323213 run iperf3-srv_10.42.42.10(pid=16139): Launched 08:47:42.449308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:47:42.672623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:43.005856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16140): Launched 08:47:43.276791 run iperf3-srv_10.42.42.10(pid=16141): Launched 08:47:43.393624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:47:43.601833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:43.913422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16142): Launched 08:47:44.181687 run iperf3-srv_10.42.42.10(pid=16143): Launched 08:47:44.297441 tst iperf3m4.py:8: start network... 08:47:44.505566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:44.987871 run create_hlr_db(pid=16144): Launched 08:47:45.114363 bus /gobi_6: Setting Powered False 08:47:46.173592 run create_hlr_db(pid=16144): Terminated: ok {rc=0} 08:47:46.612524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16146): Launched 08:47:46.939411 run osmo-hlr_10.42.42.2(pid=16147): Launched 08:47:47.154514 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:47.762818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16149): Launched 08:47:48.078947 run osmo-stp_10.42.42.5(pid=16150): Launched 08:47:48.197207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:48.733833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16152): Launched 08:47:48.851942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:49.115065 run patchelf(pid=16153): Launched 08:47:49.287022 run osmo-stp_10.42.42.5(pid=16150): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16150)] 08:47:49.417840 run osmo-stp_10.42.42.5(pid=16150): stdout: | (launched: 2022-12-09_08:47:48.021524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:49.550576 run osmo-stp_10.42.42.5(pid=16150): stderr: | [0;m[38;5;43m20221209084748190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084748190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084748190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084748191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084748191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084748191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084748191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:49.683098 run osmo-stp_10.42.42.5(pid=16150): stdout: | (launched: 2022-12-09_08:47:48.021524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:49.810189 run osmo-stp_10.42.42.5(pid=16150): stderr: | [0;m[38;5;43m20221209084748190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084748190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084748190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084748191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084748191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084748191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084748191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:49.960515 run patchelf(pid=16153): Terminating (SIGINT) 08:47:50.134778 run patchelf(pid=16153): Terminated: ok {rc=0} 08:47:50.260463 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16150): Process ended prematurely: osmo-stp_10.42.42.5(pid=16150) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16150)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:47:50.270088 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:47:50.297707 run osmo-hlr_10.42.42.2(pid=16147): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16147)] 08:47:50.345726 run osmo-hlr_10.42.42.2(pid=16147): stdout: | (launched: 2022-12-09_08:47:46.882108) 08:47:50.395351 run osmo-hlr_10.42.42.2(pid=16147): stderr: | [0;m[1;31m20221209084747185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084747185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084747185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084747185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084747185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084747185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084747211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084747220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084747220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084747220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:50.445784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16136): Terminating (SIGTERM) 08:47:50.486041 run iperf3-srv_10.42.42.10(pid=16137): Terminating (SIGTERM) 08:47:50.526106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16138): Terminating (SIGTERM) 08:47:50.566211 run iperf3-srv_10.42.42.10(pid=16139): Terminating (SIGTERM) 08:47:50.607590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16140): Terminating (SIGTERM) 08:47:50.648216 run iperf3-srv_10.42.42.10(pid=16141): Terminating (SIGTERM) 08:47:50.688200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16142): Terminating (SIGTERM) 08:47:50.728061 run iperf3-srv_10.42.42.10(pid=16143): Terminating (SIGTERM) 08:47:50.768003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16146): Terminating (SIGTERM) 08:47:50.807986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16149): Terminating (SIGTERM) 08:47:50.847877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16152): Terminating (SIGTERM) 08:47:50.888194 --- ParallelTerminationStrategy: PID 16136 died... 08:47:50.907239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16136): Terminated: ok {rc=0} 08:47:50.951676 --- ParallelTerminationStrategy: PID 16137 died... 08:47:50.970300 run iperf3-srv_10.42.42.10(pid=16137): Terminated {rc=256} 08:47:51.014333 --- ParallelTerminationStrategy: PID 16138 died... 08:47:51.033063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16138): Terminated: ok {rc=0} 08:47:51.077716 --- ParallelTerminationStrategy: PID 16139 died... 08:47:51.096278 run iperf3-srv_10.42.42.10(pid=16139): Terminated {rc=256} 08:47:51.140265 --- ParallelTerminationStrategy: PID 16140 died... 08:47:51.158992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16140): Terminated: ok {rc=0} 08:47:51.203468 --- ParallelTerminationStrategy: PID 16141 died... 08:47:51.222034 run iperf3-srv_10.42.42.10(pid=16141): Terminated {rc=256} 08:47:51.266081 --- ParallelTerminationStrategy: PID 16142 died... 08:47:51.284721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16142): Terminated: ok {rc=0} 08:47:51.328856 --- ParallelTerminationStrategy: PID 16143 died... 08:47:51.347884 run iperf3-srv_10.42.42.10(pid=16143): Terminated {rc=256} 08:47:51.391844 --- ParallelTerminationStrategy: PID 16146 died... 08:47:51.410558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16146): Terminated: ok {rc=0} 08:47:51.455057 --- ParallelTerminationStrategy: PID 16149 died... 08:47:51.473889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16149): Terminated: ok {rc=0} 08:47:51.517856 --- ParallelTerminationStrategy: PID 16152 died... 08:47:51.536559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16152): Terminated: ok {rc=0} 08:47:51.622579 bus /gobi_4: Setting Powered False 08:47:52.725147 bus /gobi_4: Setting Powered False 08:47:53.842465 bus /gobi_1: Setting Powered False 08:47:54.942812 bus /gobi_1: Setting Powered False 08:47:56.056852 bus /gobi_0: Setting Powered False 08:47:57.154865 bus /gobi_0: Setting Powered False 08:47:58.273959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:47:59.377664 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:59.390199 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:47:59.463666 tst ping.py: using LAC 20302 08:47:59.592872 tst ping.py: using RAC 157 08:47:59.720881 tst ping.py: using CellId 20302 08:47:59.841403 tst ping.py: using BVCI 20303 08:47:59.953551 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:59.964650 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:59.975658 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:59.986754 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:47:59.997589 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:00.008332 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:00.019424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:00.030385 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:48:00.150096 tst ping.py:19: start network... 08:48:00.370302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:00.879928 run create_hlr_db(pid=16154): Launched 08:48:01.030101 bus /gobi_6: Setting Powered False 08:48:02.125568 run create_hlr_db(pid=16154): Terminated: ok {rc=0} 08:48:02.595841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16156): Launched 08:48:02.922513 run osmo-hlr_10.42.42.2(pid=16157): Launched 08:48:03.047753 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:03.617580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16159): Launched 08:48:03.943697 run osmo-stp_10.42.42.5(pid=16160): Launched 08:48:04.068737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:04.633702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16162): Launched 08:48:04.758305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:05.035078 run patchelf(pid=16163): Launched 08:48:05.216102 run osmo-stp_10.42.42.5(pid=16160): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16160)] 08:48:05.354215 run osmo-stp_10.42.42.5(pid=16160): stdout: | (launched: 2022-12-09_08:48:03.883645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:05.493795 run osmo-stp_10.42.42.5(pid=16160): stderr: | [0;m[38;5;43m20221209084804072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084804072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084804073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084804073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084804074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084804074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084804074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:05.633684 run osmo-stp_10.42.42.5(pid=16160): stdout: | (launched: 2022-12-09_08:48:03.883645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:05.767740 run osmo-stp_10.42.42.5(pid=16160): stderr: | [0;m[38;5;43m20221209084804072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084804072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084804073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084804073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084804074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084804074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084804074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:05.926661 run patchelf(pid=16163): Terminating (SIGINT) 08:48:06.109214 run patchelf(pid=16163): Terminated: ok {rc=0} 08:48:06.240869 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16160): Process ended prematurely: osmo-stp_10.42.42.5(pid=16160) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16160)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 08:48:06.251008 tst ping.py:22: Test FAILED (6.9 sec) 08:48:06.279946 run osmo-hlr_10.42.42.2(pid=16157): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16157)] 08:48:06.331155 run osmo-hlr_10.42.42.2(pid=16157): stdout: | (launched: 2022-12-09_08:48:02.862528) 08:48:06.383567 run osmo-hlr_10.42.42.2(pid=16157): stderr: | [0;m[1;31m20221209084803060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084803060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084803060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084803060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084803060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084803060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084803073 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084803081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084803081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084803081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:06.436683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16156): Terminating (SIGTERM) 08:48:06.478970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16159): Terminating (SIGTERM) 08:48:06.521340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16162): Terminating (SIGTERM) 08:48:06.564066 --- ParallelTerminationStrategy: PID 16156 died... 08:48:06.584454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16156): Terminated: ok {rc=0} 08:48:06.631871 --- ParallelTerminationStrategy: PID 16159 died... 08:48:06.651855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16159): Terminated: ok {rc=0} 08:48:06.699124 --- ParallelTerminationStrategy: PID 16162 died... 08:48:06.718847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16162): Terminated: ok {rc=0} 08:48:06.807396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:48:07.896504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:07.908814 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:48:07.983616 tst ping_idle_ping.py: using LAC 20303 08:48:08.112889 tst ping_idle_ping.py: using RAC 158 08:48:08.240353 tst ping_idle_ping.py: using CellId 20303 08:48:08.368795 tst ping_idle_ping.py: using BVCI 20304 08:48:08.481130 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:08.492380 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:08.503535 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:08.514551 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:08.525710 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:08.536515 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:08.547655 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:48:08.559000 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:48:08.676427 tst ping_idle_ping.py:24: start network... 08:48:08.882054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:09.366140 run create_hlr_db(pid=16164): Launched 08:48:09.490873 bus /gobi_6: Setting Powered False 08:48:10.551487 run create_hlr_db(pid=16164): Terminated: ok {rc=0} 08:48:10.998574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Launched 08:48:11.326359 run osmo-hlr_10.42.42.2(pid=16168): Launched 08:48:11.451944 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:12.020025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Launched 08:48:12.347763 run osmo-stp_10.42.42.5(pid=16171): Launched 08:48:12.472408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:13.037122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16173): Launched 08:48:13.161693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:13.437454 run patchelf(pid=16174): Launched 08:48:13.618938 run osmo-stp_10.42.42.5(pid=16171): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] 08:48:13.757297 run osmo-stp_10.42.42.5(pid=16171): stdout: | (launched: 2022-12-09_08:48:12.288088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:13.897351 run osmo-stp_10.42.42.5(pid=16171): stderr: | [0;m[38;5;43m20221209084812477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084812477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084812477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084812478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084812478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084812478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084812478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:14.037827 run osmo-stp_10.42.42.5(pid=16171): stdout: | (launched: 2022-12-09_08:48:12.288088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:14.172038 run osmo-stp_10.42.42.5(pid=16171): stderr: | [0;m[38;5;43m20221209084812477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084812477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084812477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084812478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084812478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084812478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084812478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:14.331280 run patchelf(pid=16174): Terminating (SIGINT) 08:48:14.514038 run patchelf(pid=16174): Terminated: ok {rc=0} 08:48:14.646299 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16171): Process ended prematurely: osmo-stp_10.42.42.5(pid=16171) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:48:14.655996 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:48:14.684817 run osmo-hlr_10.42.42.2(pid=16168): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16168)] 08:48:14.735670 run osmo-hlr_10.42.42.2(pid=16168): stdout: | (launched: 2022-12-09_08:48:11.266563) 08:48:14.788171 run osmo-hlr_10.42.42.2(pid=16168): stderr: | [0;m[1;31m20221209084811462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084811462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084811462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084811462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084811462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084811462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084811474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084811483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084811483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084811483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:14.841038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Terminating (SIGTERM) 08:48:14.883560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Terminating (SIGTERM) 08:48:14.926127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16173): Terminating (SIGTERM) 08:48:14.969091 --- ParallelTerminationStrategy: PID 16167 died... 08:48:14.989346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Terminated: ok {rc=0} 08:48:15.036591 --- ParallelTerminationStrategy: PID 16170 died... 08:48:15.056258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Terminated: ok {rc=0} 08:48:15.102979 --- ParallelTerminationStrategy: PID 16173 died... 08:48:15.122448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16173): Terminated: ok {rc=0} 08:48:15.211347 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:48:16.529526 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:16.540022 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:48:16.576489 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:48:16.618668 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:48:16.712133 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:48:16.763108 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:48:16.813581 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:48:17.385102 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:48:17.439729 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:17.451300 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:48:17.525172 tst cs_paging_gprs_active.py: using LAC 20304 08:48:17.656849 tst cs_paging_gprs_active.py: using RAC 159 08:48:17.786830 tst cs_paging_gprs_active.py: using CellId 20304 08:48:17.918449 tst cs_paging_gprs_active.py: using BVCI 20305 08:48:18.040004 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.051576 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.063050 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.074753 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.086245 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.097930 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.109607 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.121197 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:18.132869 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:48:18.254213 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:48:18.376445 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:48:18.603195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:18.940178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16178): Launched 08:48:19.230688 run iperf3-srv_10.42.42.10(pid=16179): Launched 08:48:19.355984 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:48:19.581314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:19.915960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16180): Launched 08:48:20.206453 run iperf3-srv_10.42.42.10(pid=16181): Launched 08:48:20.331484 tst cs_paging_gprs_active.py:38: start network... 08:48:20.556635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:21.074321 run create_hlr_db(pid=16182): Launched 08:48:21.200901 bus /gobi_6: Setting Powered False 08:48:22.266629 run create_hlr_db(pid=16182): Terminated: ok {rc=0} 08:48:22.728879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16184): Launched 08:48:23.061906 run osmo-hlr_10.42.42.2(pid=16185): Launched 08:48:23.188240 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:23.759504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16187): Launched 08:48:24.093243 run osmo-stp_10.42.42.5(pid=16188): Launched 08:48:24.220517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:24.795910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16190): Launched 08:48:24.923436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:25.206030 run patchelf(pid=16191): Launched 08:48:25.390904 run osmo-stp_10.42.42.5(pid=16188): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16188)] 08:48:25.531487 run osmo-stp_10.42.42.5(pid=16188): stdout: | (launched: 2022-12-09_08:48:24.032251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:25.673665 run osmo-stp_10.42.42.5(pid=16188): stderr: | [0;m[38;5;43m20221209084824223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084824223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084824223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084824224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084824224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084824224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084824224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:25.815751 run osmo-stp_10.42.42.5(pid=16188): stdout: | (launched: 2022-12-09_08:48:24.032251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:25.952547 run osmo-stp_10.42.42.5(pid=16188): stderr: | [0;m[38;5;43m20221209084824223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084824223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084824223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084824224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084824224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084824224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084824224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:26.114274 run patchelf(pid=16191): Terminating (SIGINT) 08:48:26.300407 run patchelf(pid=16191): Terminated: ok {rc=0} 08:48:26.435099 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16188): Process ended prematurely: osmo-stp_10.42.42.5(pid=16188) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16188)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:48:26.445573 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:48:26.475223 run osmo-hlr_10.42.42.2(pid=16185): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16185)] 08:48:26.526308 run osmo-hlr_10.42.42.2(pid=16185): stdout: | (launched: 2022-12-09_08:48:23.001483) 08:48:26.578690 run osmo-hlr_10.42.42.2(pid=16185): stderr: | [0;m[1;31m20221209084823199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084823199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084823199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084823199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084823199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084823199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084823211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084823220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084823220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084823220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:26.632159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16178): Terminating (SIGTERM) 08:48:26.674818 run iperf3-srv_10.42.42.10(pid=16179): Terminating (SIGTERM) 08:48:26.717430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16180): Terminating (SIGTERM) 08:48:26.760316 run iperf3-srv_10.42.42.10(pid=16181): Terminating (SIGTERM) 08:48:26.802981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16184): Terminating (SIGTERM) 08:48:26.845624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16187): Terminating (SIGTERM) 08:48:26.888281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16190): Terminating (SIGTERM) 08:48:26.931170 --- ParallelTerminationStrategy: PID 16178 died... 08:48:26.951663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16178): Terminated: ok {rc=0} 08:48:26.999507 --- ParallelTerminationStrategy: PID 16179 died... 08:48:27.019168 run iperf3-srv_10.42.42.10(pid=16179): Terminated {rc=256} 08:48:27.065978 --- ParallelTerminationStrategy: PID 16180 died... 08:48:27.085829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16180): Terminated: ok {rc=0} 08:48:27.132689 --- ParallelTerminationStrategy: PID 16181 died... 08:48:27.152292 run iperf3-srv_10.42.42.10(pid=16181): Terminated {rc=256} 08:48:27.199173 --- ParallelTerminationStrategy: PID 16184 died... 08:48:27.218893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16184): Terminated: ok {rc=0} 08:48:27.265667 --- ParallelTerminationStrategy: PID 16187 died... 08:48:27.285268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16187): Terminated: ok {rc=0} 08:48:27.331982 --- ParallelTerminationStrategy: PID 16190 died... 08:48:27.351556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16190): Terminated: ok {rc=0} 08:48:27.440374 bus /gobi_0: Setting Powered False 08:48:28.540397 bus /gobi_0: Setting Powered False 08:48:29.657296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:48:30.808451 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:30.820803 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:48:30.918071 tst iperf3.py: using LAC 20305 08:48:31.054650 tst iperf3.py: using RAC 160 08:48:31.217088 tst iperf3.py: using CellId 20305 08:48:31.353098 tst iperf3.py: using BVCI 20306 08:48:31.481536 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.494010 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.506450 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.520029 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.532819 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.545902 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.559121 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.572107 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:31.584718 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:48:31.738512 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:48:31.972852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:32.294770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16192): Launched 08:48:32.589482 run iperf3-srv_10.42.42.10(pid=16193): Launched 08:48:32.713898 tst iperf3.py:8: start network... 08:48:32.938685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:33.453957 run create_hlr_db(pid=16194): Launched 08:48:33.579916 bus /gobi_6: Setting Powered False 08:48:34.644607 run create_hlr_db(pid=16194): Terminated: ok {rc=0} 08:48:35.086778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16196): Launched 08:48:35.398274 run osmo-hlr_10.42.42.2(pid=16197): Launched 08:48:35.516493 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:36.064330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16199): Launched 08:48:36.375070 run osmo-stp_10.42.42.5(pid=16200): Launched 08:48:36.494654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:37.031627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16202): Launched 08:48:37.150346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:37.413710 run patchelf(pid=16203): Launched 08:48:37.585750 run osmo-stp_10.42.42.5(pid=16200): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16200)] 08:48:37.717764 run osmo-stp_10.42.42.5(pid=16200): stdout: | (launched: 2022-12-09_08:48:36.317806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:37.850448 run osmo-stp_10.42.42.5(pid=16200): stderr: | [0;m[38;5;43m20221209084836488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084836488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084836488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084836489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084836489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084836490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084836490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:37.983066 run osmo-stp_10.42.42.5(pid=16200): stdout: | (launched: 2022-12-09_08:48:36.317806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:38.110087 run osmo-stp_10.42.42.5(pid=16200): stderr: | [0;m[38;5;43m20221209084836488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084836488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084836488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084836489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084836489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084836490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084836490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:38.260413 run patchelf(pid=16203): Terminating (SIGINT) 08:48:38.434183 run patchelf(pid=16203): Terminated: ok {rc=0} 08:48:38.559092 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16200): Process ended prematurely: osmo-stp_10.42.42.5(pid=16200) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16200)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 08:48:38.568631 tst iperf3.py:8: Test FAILED (7.8 sec) 08:48:38.596069 run osmo-hlr_10.42.42.2(pid=16197): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16197)] 08:48:38.644393 run osmo-hlr_10.42.42.2(pid=16197): stdout: | (launched: 2022-12-09_08:48:35.341308) 08:48:38.694334 run osmo-hlr_10.42.42.2(pid=16197): stderr: | [0;m[1;31m20221209084835516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084835516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084835516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084835516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084835516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084835516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084835529 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084835537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084835537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084835537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:38.744696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16192): Terminating (SIGTERM) 08:48:38.785628 run iperf3-srv_10.42.42.10(pid=16193): Terminating (SIGTERM) 08:48:38.826501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16196): Terminating (SIGTERM) 08:48:38.866718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16199): Terminating (SIGTERM) 08:48:38.906897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16202): Terminating (SIGTERM) 08:48:38.947192 --- ParallelTerminationStrategy: PID 16192 died... 08:48:38.966383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16192): Terminated: ok {rc=0} 08:48:39.010632 --- ParallelTerminationStrategy: PID 16193 died... 08:48:39.029229 run iperf3-srv_10.42.42.10(pid=16193): Terminated {rc=256} 08:48:39.073204 --- ParallelTerminationStrategy: PID 16196 died... 08:48:39.091778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16196): Terminated: ok {rc=0} 08:48:39.135967 --- ParallelTerminationStrategy: PID 16199 died... 08:48:39.154722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16199): Terminated: ok {rc=0} 08:48:39.198825 --- ParallelTerminationStrategy: PID 16202 died... 08:48:39.217621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16202): Terminated: ok {rc=0} 08:48:39.304590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:48:40.453840 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:40.465542 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:48:40.538929 tst iperf3m4.py: using LAC 20306 08:48:40.663512 tst iperf3m4.py: using RAC 161 08:48:40.787605 tst iperf3m4.py: using CellId 20306 08:48:40.912410 tst iperf3m4.py: using BVCI 20307 08:48:41.026747 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.037947 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.048810 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.059775 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.070821 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.081759 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.092672 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.103519 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:48:41.114667 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:48:41.236850 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:48:41.362264 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:48:41.481154 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:48:41.604654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:48:41.831178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:42.167164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16204): Launched 08:48:42.456250 run iperf3-srv_10.42.42.10(pid=16205): Launched 08:48:42.580874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:48:42.805840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:43.140822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16206): Launched 08:48:43.430064 run iperf3-srv_10.42.42.10(pid=16207): Launched 08:48:43.554407 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:48:43.779296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:44.114132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16208): Launched 08:48:44.403498 run iperf3-srv_10.42.42.10(pid=16209): Launched 08:48:44.527906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:48:44.752721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:48:45.087589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16210): Launched 08:48:45.376085 run iperf3-srv_10.42.42.10(pid=16211): Launched 08:48:45.500392 tst iperf3m4.py:8: start network... 08:48:45.724670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:46.286050 run create_hlr_db(pid=16212): Launched 08:48:46.443990 bus /gobi_6: Setting Powered False 08:48:47.509589 run create_hlr_db(pid=16212): Terminated: ok {rc=0} 08:48:47.971976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16214): Launched 08:48:48.303690 run osmo-hlr_10.42.42.2(pid=16215): Launched 08:48:48.431887 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:49.004317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16217): Launched 08:48:49.336073 run osmo-stp_10.42.42.5(pid=16218): Launched 08:48:49.463377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:50.038138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16220): Launched 08:48:50.165889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:50.447027 run patchelf(pid=16221): Launched 08:48:50.631104 run osmo-stp_10.42.42.5(pid=16218): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16218)] 08:48:50.771459 run osmo-stp_10.42.42.5(pid=16218): stdout: | (launched: 2022-12-09_08:48:49.275255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:50.913443 run osmo-stp_10.42.42.5(pid=16218): stderr: | [0;m[38;5;43m20221209084849465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084849465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084849466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084849466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084849466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084849467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084849467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:51.056358 run osmo-stp_10.42.42.5(pid=16218): stdout: | (launched: 2022-12-09_08:48:49.275255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:51.192531 run osmo-stp_10.42.42.5(pid=16218): stderr: | [0;m[38;5;43m20221209084849465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084849465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084849466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084849466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084849466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084849467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084849467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:51.353928 run patchelf(pid=16221): Terminating (SIGINT) 08:48:51.539248 run patchelf(pid=16221): Terminated: ok {rc=0} 08:48:51.672502 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16218): Process ended prematurely: osmo-stp_10.42.42.5(pid=16218) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16218)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:48:51.682745 tst iperf3m4.py:8: Test FAILED (11.3 sec) 08:48:51.712336 run osmo-hlr_10.42.42.2(pid=16215): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16215)] 08:48:51.763151 run osmo-hlr_10.42.42.2(pid=16215): stdout: | (launched: 2022-12-09_08:48:48.243155) 08:48:51.815588 run osmo-hlr_10.42.42.2(pid=16215): stderr: | [0;m[1;31m20221209084848440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084848440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084848440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084848440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084848440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084848440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084848452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084848461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084848461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084848461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:51.868701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16204): Terminating (SIGTERM) 08:48:51.911475 run iperf3-srv_10.42.42.10(pid=16205): Terminating (SIGTERM) 08:48:51.954432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16206): Terminating (SIGTERM) 08:48:51.996989 run iperf3-srv_10.42.42.10(pid=16207): Terminating (SIGTERM) 08:48:52.039301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16208): Terminating (SIGTERM) 08:48:52.081642 run iperf3-srv_10.42.42.10(pid=16209): Terminating (SIGTERM) 08:48:52.123978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16210): Terminating (SIGTERM) 08:48:52.166311 run iperf3-srv_10.42.42.10(pid=16211): Terminating (SIGTERM) 08:48:52.208287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16214): Terminating (SIGTERM) 08:48:52.250747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16217): Terminating (SIGTERM) 08:48:52.292810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16220): Terminating (SIGTERM) 08:48:52.335884 --- ParallelTerminationStrategy: PID 16204 died... 08:48:52.355934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16204): Terminated: ok {rc=0} 08:48:52.403004 --- ParallelTerminationStrategy: PID 16205 died... 08:48:52.422654 run iperf3-srv_10.42.42.10(pid=16205): Terminated {rc=256} 08:48:52.469316 --- ParallelTerminationStrategy: PID 16206 died... 08:48:52.488839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16206): Terminated: ok {rc=0} 08:48:52.535794 --- ParallelTerminationStrategy: PID 16207 died... 08:48:52.555333 run iperf3-srv_10.42.42.10(pid=16207): Terminated {rc=256} 08:48:52.601893 --- ParallelTerminationStrategy: PID 16208 died... 08:48:52.621638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16208): Terminated: ok {rc=0} 08:48:52.668410 --- ParallelTerminationStrategy: PID 16209 died... 08:48:52.687798 run iperf3-srv_10.42.42.10(pid=16209): Terminated {rc=256} 08:48:52.734437 --- ParallelTerminationStrategy: PID 16210 died... 08:48:52.754089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16210): Terminated: ok {rc=0} 08:48:52.800854 --- ParallelTerminationStrategy: PID 16211 died... 08:48:52.820894 run iperf3-srv_10.42.42.10(pid=16211): Terminated {rc=256} 08:48:52.867694 --- ParallelTerminationStrategy: PID 16214 died... 08:48:52.887435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16214): Terminated: ok {rc=0} 08:48:52.934557 --- ParallelTerminationStrategy: PID 16217 died... 08:48:52.954705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16217): Terminated: ok {rc=0} 08:48:53.001726 --- ParallelTerminationStrategy: PID 16220 died... 08:48:53.021572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16220): Terminated: ok {rc=0} 08:48:53.109807 bus /gobi_4: Setting Powered False 08:48:54.208859 bus /gobi_4: Setting Powered False 08:48:55.323814 bus /gobi_1: Setting Powered False 08:48:56.424026 bus /gobi_1: Setting Powered False 08:48:57.539556 bus /gobi_0: Setting Powered False 08:48:58.638836 bus /gobi_0: Setting Powered False 08:48:59.753392 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:49:00.871529 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:00.884915 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:49:00.976881 tst ping.py: using LAC 20307 08:49:01.137422 tst ping.py: using RAC 162 08:49:01.272645 tst ping.py: using CellId 20307 08:49:01.403807 tst ping.py: using BVCI 20308 08:49:01.520003 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:01.532105 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:01.543623 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:01.555096 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:01.566787 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:01.578435 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:01.590401 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:01.602242 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:49:01.726415 tst ping.py:19: start network... 08:49:02.002373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:02.514783 run create_hlr_db(pid=16222): Launched 08:49:02.639130 bus /gobi_6: Setting Powered False 08:49:03.703031 run create_hlr_db(pid=16222): Terminated: ok {rc=0} 08:49:04.156792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16224): Launched 08:49:04.484567 run osmo-hlr_10.42.42.2(pid=16225): Launched 08:49:04.610283 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:05.180022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16227): Launched 08:49:05.507239 run osmo-stp_10.42.42.5(pid=16228): Launched 08:49:05.632507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:06.195557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16230): Launched 08:49:06.319800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:06.595091 run patchelf(pid=16231): Launched 08:49:06.775718 run osmo-stp_10.42.42.5(pid=16228): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16228)] 08:49:06.913148 run osmo-stp_10.42.42.5(pid=16228): stdout: | (launched: 2022-12-09_08:49:05.447337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:07.052650 run osmo-stp_10.42.42.5(pid=16228): stderr: | [0;m[38;5;43m20221209084905636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084905636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084905636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084905637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084905637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084905637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084905637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:07.191667 run osmo-stp_10.42.42.5(pid=16228): stdout: | (launched: 2022-12-09_08:49:05.447337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:07.324773 run osmo-stp_10.42.42.5(pid=16228): stderr: | [0;m[38;5;43m20221209084905636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084905636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084905636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084905637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084905637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084905637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084905637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:07.482790 run patchelf(pid=16231): Terminating (SIGINT) 08:49:07.664432 run patchelf(pid=16231): Terminated: ok {rc=0} 08:49:07.795246 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16228): Process ended prematurely: osmo-stp_10.42.42.5(pid=16228) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16228)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 08:49:07.804785 tst ping.py:22: Test FAILED (6.9 sec) 08:49:07.833580 run osmo-hlr_10.42.42.2(pid=16225): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16225)] 08:49:07.884248 run osmo-hlr_10.42.42.2(pid=16225): stdout: | (launched: 2022-12-09_08:49:04.424255) 08:49:07.936468 run osmo-hlr_10.42.42.2(pid=16225): stderr: | [0;m[1;31m20221209084904621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084904621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084904621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084904621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084904621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084904621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084904633 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084904642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084904642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084904642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:07.989451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16224): Terminating (SIGTERM) 08:49:08.031946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16227): Terminating (SIGTERM) 08:49:08.075838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16230): Terminating (SIGTERM) 08:49:08.118418 --- ParallelTerminationStrategy: PID 16224 died... 08:49:08.138448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16224): Terminated: ok {rc=0} 08:49:08.185388 --- ParallelTerminationStrategy: PID 16227 died... 08:49:08.204896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16227): Terminated: ok {rc=0} 08:49:08.251675 --- ParallelTerminationStrategy: PID 16230 died... 08:49:08.271192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16230): Terminated: ok {rc=0} 08:49:08.360290 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:49:09.448295 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:09.460545 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:49:09.535116 tst ping_idle_ping.py: using LAC 20308 08:49:09.662977 tst ping_idle_ping.py: using RAC 163 08:49:09.791843 tst ping_idle_ping.py: using CellId 20308 08:49:09.920556 tst ping_idle_ping.py: using BVCI 20309 08:49:10.039462 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:10.051853 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:10.063276 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:10.074960 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:10.086457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:10.098130 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:10.109846 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:49:10.121459 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:49:10.243763 tst ping_idle_ping.py:24: start network... 08:49:10.464280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:10.974279 run create_hlr_db(pid=16232): Launched 08:49:11.098932 bus /gobi_6: Setting Powered False 08:49:12.163857 run create_hlr_db(pid=16232): Terminated: ok {rc=0} 08:49:12.602316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16234): Launched 08:49:12.907846 run osmo-hlr_10.42.42.2(pid=16235): Launched 08:49:13.023669 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:13.551376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16237): Launched 08:49:13.857135 run osmo-stp_10.42.42.5(pid=16238): Launched 08:49:13.973775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:14.501735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16240): Launched 08:49:14.618055 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:14.875574 run patchelf(pid=16241): Launched 08:49:15.045617 run osmo-stp_10.42.42.5(pid=16238): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16238)] 08:49:15.176092 run osmo-stp_10.42.42.5(pid=16238): stdout: | (launched: 2022-12-09_08:49:13.800589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:15.306843 run osmo-stp_10.42.42.5(pid=16238): stderr: | [0;m[38;5;43m20221209084913969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084913969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084913969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084913970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084913970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084913970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084913970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:15.437736 run osmo-stp_10.42.42.5(pid=16238): stdout: | (launched: 2022-12-09_08:49:13.800589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:15.563527 run osmo-stp_10.42.42.5(pid=16238): stderr: | [0;m[38;5;43m20221209084913969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084913969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084913969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084913970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084913970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084913970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084913970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:15.711475 run patchelf(pid=16241): Terminating (SIGINT) 08:49:15.903865 run patchelf(pid=16241): Terminated: ok {rc=0} 08:49:16.042054 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16238): Process ended prematurely: osmo-stp_10.42.42.5(pid=16238) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16238)] [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:49:16.051906 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:49:16.079768 run osmo-hlr_10.42.42.2(pid=16235): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16235)] 08:49:16.128800 run osmo-hlr_10.42.42.2(pid=16235): stdout: | (launched: 2022-12-09_08:49:12.851268) 08:49:16.179696 run osmo-hlr_10.42.42.2(pid=16235): stderr: | [0;m[1;31m20221209084913026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084913026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084913026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084913026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084913027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084913027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084913039 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084913047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084913048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084913048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:16.231165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16234): Terminating (SIGTERM) 08:49:16.272380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16237): Terminating (SIGTERM) 08:49:16.314215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16240): Terminating (SIGTERM) 08:49:16.356235 --- ParallelTerminationStrategy: PID 16234 died... 08:49:16.375757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16234): Terminated: ok {rc=0} 08:49:16.420923 --- ParallelTerminationStrategy: PID 16237 died... 08:49:16.440397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16237): Terminated: ok {rc=0} 08:49:16.486010 --- ParallelTerminationStrategy: PID 16240 died... 08:49:16.505619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16240): Terminated: ok {rc=0} 08:49:16.595367 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:49:17.901586 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:49:17.907646 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:49:17.941053 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 08:49:17.979956 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 08:49:18.067502 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:49:18.101388 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 08:49:18.140629 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 08:49:18.745364 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 08:49:18.795201 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:18.806857 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:49:18.863256 tst cs_paging_gprs_active.py: using LAC 20309 08:49:18.984892 tst cs_paging_gprs_active.py: using RAC 164 08:49:19.105050 tst cs_paging_gprs_active.py: using CellId 20309 08:49:19.226146 tst cs_paging_gprs_active.py: using BVCI 20310 08:49:19.338682 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.350199 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.361490 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.372754 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.383980 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.395242 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.406648 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.417801 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:19.429297 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:49:19.547464 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:49:19.671910 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:49:19.882359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:20.195852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16246): Launched 08:49:20.469411 run iperf3-srv_10.42.42.10(pid=16247): Launched 08:49:20.586880 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:49:20.796468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:21.110919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16248): Launched 08:49:21.383979 run iperf3-srv_10.42.42.10(pid=16249): Launched 08:49:21.500647 tst cs_paging_gprs_active.py:38: start network... 08:49:21.709944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:22.195074 run create_hlr_db(pid=16250): Launched 08:49:22.326813 bus /gobi_6: Setting Powered False 08:49:23.392137 run create_hlr_db(pid=16250): Terminated: ok {rc=0} 08:49:23.835323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16252): Launched 08:49:24.147991 run osmo-hlr_10.42.42.2(pid=16253): Launched 08:49:24.267004 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:24.805127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16255): Launched 08:49:25.117669 run osmo-stp_10.42.42.5(pid=16256): Launched 08:49:25.237223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:25.774811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16258): Launched 08:49:25.893779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:26.157592 run patchelf(pid=16259): Launched 08:49:26.329892 run osmo-stp_10.42.42.5(pid=16256): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16256)] 08:49:26.461475 run osmo-stp_10.42.42.5(pid=16256): stdout: | (launched: 2022-12-09_08:49:25.060207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:26.594244 run osmo-stp_10.42.42.5(pid=16256): stderr: | [0;m[38;5;43m20221209084925227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084925228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084925228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084925228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084925229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084925229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084925229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:26.727197 run osmo-stp_10.42.42.5(pid=16256): stdout: | (launched: 2022-12-09_08:49:25.060207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:26.854802 run osmo-stp_10.42.42.5(pid=16256): stderr: | [0;m[38;5;43m20221209084925227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084925228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084925228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084925228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084925229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084925229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084925229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:27.005986 run patchelf(pid=16259): Terminating (SIGINT) 08:49:27.180512 run patchelf(pid=16259): Terminated: ok {rc=0} 08:49:27.306203 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16256): Process ended prematurely: osmo-stp_10.42.42.5(pid=16256) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16256)] [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 08:49:27.315642 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:49:27.343113 run osmo-hlr_10.42.42.2(pid=16253): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16253)] 08:49:27.391602 run osmo-hlr_10.42.42.2(pid=16253): stdout: | (launched: 2022-12-09_08:49:24.090284) 08:49:27.441619 run osmo-hlr_10.42.42.2(pid=16253): stderr: | [0;m[1;31m20221209084924266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084924266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084924266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084924266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084924266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084924266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084924279 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084924289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084924289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084924289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:27.492177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16246): Terminating (SIGTERM) 08:49:27.532541 run iperf3-srv_10.42.42.10(pid=16247): Terminating (SIGTERM) 08:49:27.573132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16248): Terminating (SIGTERM) 08:49:27.614183 run iperf3-srv_10.42.42.10(pid=16249): Terminating (SIGTERM) 08:49:27.654633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16252): Terminating (SIGTERM) 08:49:27.695436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16255): Terminating (SIGTERM) 08:49:27.735770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16258): Terminating (SIGTERM) 08:49:27.776435 --- ParallelTerminationStrategy: PID 16246 died... 08:49:27.795842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16246): Terminated: ok {rc=0} 08:49:27.840809 --- ParallelTerminationStrategy: PID 16247 died... 08:49:27.860128 run iperf3-srv_10.42.42.10(pid=16247): Terminated {rc=256} 08:49:27.904828 --- ParallelTerminationStrategy: PID 16248 died... 08:49:27.924196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16248): Terminated: ok {rc=0} 08:49:27.969144 --- ParallelTerminationStrategy: PID 16249 died... 08:49:27.988161 run iperf3-srv_10.42.42.10(pid=16249): Terminated {rc=256} 08:49:28.033179 --- ParallelTerminationStrategy: PID 16252 died... 08:49:28.052223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16252): Terminated: ok {rc=0} 08:49:28.097573 --- ParallelTerminationStrategy: PID 16255 died... 08:49:28.116382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16255): Terminated: ok {rc=0} 08:49:28.160807 --- ParallelTerminationStrategy: PID 16258 died... 08:49:28.180182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16258): Terminated: ok {rc=0} 08:49:28.267903 bus /gobi_0: Setting Powered False 08:49:29.369860 bus /gobi_0: Setting Powered False 08:49:30.485777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 08:49:31.634185 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:31.646910 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:49:31.703587 tst iperf3.py: using LAC 20310 08:49:31.876590 tst iperf3.py: using RAC 165 08:49:32.001266 tst iperf3.py: using CellId 20310 08:49:32.125304 tst iperf3.py: using BVCI 20311 08:49:32.240941 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.253248 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.265384 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.278400 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.290911 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.302784 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.315583 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.328262 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:32.340905 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:49:32.459857 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:49:32.670438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:32.983935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16261): Launched 08:49:33.256535 run iperf3-srv_10.42.42.10(pid=16262): Launched 08:49:33.373549 tst iperf3.py:8: start network... 08:49:33.582856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:34.070130 run create_hlr_db(pid=16263): Launched 08:49:34.195922 bus /gobi_6: Setting Powered False 08:49:35.258692 run create_hlr_db(pid=16263): Terminated: ok {rc=0} 08:49:35.711833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16265): Launched 08:49:36.045667 run osmo-hlr_10.42.42.2(pid=16266): Launched 08:49:36.173684 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:36.748139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16268): Launched 08:49:37.081558 run osmo-stp_10.42.42.5(pid=16269): Launched 08:49:37.208687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:37.783256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16271): Launched 08:49:37.910276 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:38.192889 run patchelf(pid=16272): Launched 08:49:38.377222 run osmo-stp_10.42.42.5(pid=16269): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16269)] 08:49:38.518081 run osmo-stp_10.42.42.5(pid=16269): stdout: | (launched: 2022-12-09_08:49:37.020553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:38.660283 run osmo-stp_10.42.42.5(pid=16269): stderr: | [0;m[38;5;43m20221209084937211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084937211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084937211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084937212 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084937212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084937212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084937212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:38.802264 run osmo-stp_10.42.42.5(pid=16269): stdout: | (launched: 2022-12-09_08:49:37.020553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:38.938448 run osmo-stp_10.42.42.5(pid=16269): stderr: | [0;m[38;5;43m20221209084937211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084937211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084937211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084937212 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084937212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084937212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084937212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:39.100599 run patchelf(pid=16272): Terminating (SIGINT) 08:49:39.287103 run patchelf(pid=16272): Terminated: ok {rc=0} 08:49:39.421646 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16269): Process ended prematurely: osmo-stp_10.42.42.5(pid=16269) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16269)] [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 08:49:39.431884 tst iperf3.py:8: Test FAILED (7.8 sec) 08:49:39.461472 run osmo-hlr_10.42.42.2(pid=16266): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16266)] 08:49:39.512484 run osmo-hlr_10.42.42.2(pid=16266): stdout: | (launched: 2022-12-09_08:49:35.984652) 08:49:39.565247 run osmo-hlr_10.42.42.2(pid=16266): stderr: | [0;m[1;31m20221209084936181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084936181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084936181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084936181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084936181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084936182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084936194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084936202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084936202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084936203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:39.618329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16261): Terminating (SIGTERM) 08:49:39.660928 run iperf3-srv_10.42.42.10(pid=16262): Terminating (SIGTERM) 08:49:39.703507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16265): Terminating (SIGTERM) 08:49:39.746167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16268): Terminating (SIGTERM) 08:49:39.788820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16271): Terminating (SIGTERM) 08:49:39.831619 --- ParallelTerminationStrategy: PID 16261 died... 08:49:39.851778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16261): Terminated: ok {rc=0} 08:49:39.898958 --- ParallelTerminationStrategy: PID 16262 died... 08:49:39.918596 run iperf3-srv_10.42.42.10(pid=16262): Terminated {rc=256} 08:49:39.965868 --- ParallelTerminationStrategy: PID 16265 died... 08:49:39.985945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16265): Terminated: ok {rc=0} 08:49:40.033178 --- ParallelTerminationStrategy: PID 16268 died... 08:49:40.052827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16268): Terminated: ok {rc=0} 08:49:40.100047 --- ParallelTerminationStrategy: PID 16271 died... 08:49:40.119871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16271): Terminated: ok {rc=0} 08:49:40.208832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 08:49:41.359827 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.372172 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:49:41.429346 tst iperf3m4.py: using LAC 20311 08:49:41.552329 tst iperf3m4.py: using RAC 166 08:49:41.675256 tst iperf3m4.py: using CellId 20311 08:49:41.797464 tst iperf3m4.py: using BVCI 20312 08:49:41.910338 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.921982 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.933360 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.944682 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.956065 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.967447 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.978879 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:41.990098 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:49:42.001668 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:49:42.126208 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:49:42.249630 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:49:42.371824 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:49:42.494860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:49:42.720662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:43.055780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16273): Launched 08:49:43.346561 run iperf3-srv_10.42.42.10(pid=16274): Launched 08:49:43.471294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:49:43.695750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:44.030719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16275): Launched 08:49:44.321171 run iperf3-srv_10.42.42.10(pid=16276): Launched 08:49:44.446174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:49:44.670987 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:45.007049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16277): Launched 08:49:45.296223 run iperf3-srv_10.42.42.10(pid=16278): Launched 08:49:45.420564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:49:45.644767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:49:45.988355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16279): Launched 08:49:46.290701 run iperf3-srv_10.42.42.10(pid=16280): Launched 08:49:46.420331 tst iperf3m4.py:8: start network... 08:49:46.634361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:47.137236 run create_hlr_db(pid=16281): Launched 08:49:47.267191 bus /gobi_6: Setting Powered False 08:49:48.331137 run create_hlr_db(pid=16281): Terminated: ok {rc=0} 08:49:48.774104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Launched 08:49:49.084569 run osmo-hlr_10.42.42.2(pid=16284): Launched 08:49:49.202953 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:49.743166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Launched 08:49:50.053209 run osmo-stp_10.42.42.5(pid=16287): Launched 08:49:50.171723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:49:50.705511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16289): Launched 08:49:50.823246 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:49:51.084480 run patchelf(pid=16290): Launched 08:49:51.256016 run osmo-stp_10.42.42.5(pid=16287): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] 08:49:51.387443 run osmo-stp_10.42.42.5(pid=16287): stdout: | (launched: 2022-12-09_08:49:49.995946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:51.520004 run osmo-stp_10.42.42.5(pid=16287): stderr: | [0;m[38;5;43m20221209084950166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084950166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084950166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084950167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084950167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084950167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084950167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:51.652506 run osmo-stp_10.42.42.5(pid=16287): stdout: | (launched: 2022-12-09_08:49:49.995946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:51.779093 run osmo-stp_10.42.42.5(pid=16287): stderr: | [0;m[38;5;43m20221209084950166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209084950166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209084950166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209084950167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209084950167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209084950167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209084950167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:51.929363 run patchelf(pid=16290): Terminating (SIGINT) 08:49:52.103185 run patchelf(pid=16290): Terminated: ok {rc=0} 08:49:52.228174 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16287): Process ended prematurely: osmo-stp_10.42.42.5(pid=16287) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 08:49:52.237923 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:49:52.265638 run osmo-hlr_10.42.42.2(pid=16284): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16284)] 08:49:52.313758 run osmo-hlr_10.42.42.2(pid=16284): stdout: | (launched: 2022-12-09_08:49:49.027081) 08:49:52.363375 run osmo-hlr_10.42.42.2(pid=16284): stderr: | [0;m[1;31m20221209084949202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209084949202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209084949202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209084949202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209084949202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209084949202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209084949234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209084949243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209084949243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209084949244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:52.413397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16273): Terminating (SIGTERM) 08:49:52.453600 run iperf3-srv_10.42.42.10(pid=16274): Terminating (SIGTERM) 08:49:52.493844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16275): Terminating (SIGTERM) 08:49:52.533947 run iperf3-srv_10.42.42.10(pid=16276): Terminating (SIGTERM) 08:49:52.574090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16277): Terminating (SIGTERM) 08:49:52.614015 run iperf3-srv_10.42.42.10(pid=16278): Terminating (SIGTERM) 08:49:52.654081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16279): Terminating (SIGTERM) 08:49:52.694313 run iperf3-srv_10.42.42.10(pid=16280): Terminating (SIGTERM) 08:49:52.734315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Terminating (SIGTERM) 08:49:52.774459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Terminating (SIGTERM) 08:49:52.814658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16289): Terminating (SIGTERM) 08:49:52.855067 --- ParallelTerminationStrategy: PID 16273 died... 08:49:52.874329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16273): Terminated: ok {rc=0} 08:49:52.918748 --- ParallelTerminationStrategy: PID 16274 died... 08:49:52.937691 run iperf3-srv_10.42.42.10(pid=16274): Terminated {rc=256} 08:49:52.981882 --- ParallelTerminationStrategy: PID 16275 died... 08:49:53.000867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16275): Terminated: ok {rc=0} 08:49:53.045518 --- ParallelTerminationStrategy: PID 16276 died... 08:49:53.064532 run iperf3-srv_10.42.42.10(pid=16276): Terminated {rc=256} 08:49:53.108800 --- ParallelTerminationStrategy: PID 16277 died... 08:49:53.128090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16277): Terminated: ok {rc=0} 08:49:53.172777 --- ParallelTerminationStrategy: PID 16278 died... 08:49:53.191779 run iperf3-srv_10.42.42.10(pid=16278): Terminated {rc=256} 08:49:53.236220 --- ParallelTerminationStrategy: PID 16279 died... 08:49:53.255155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16279): Terminated: ok {rc=0} 08:49:53.299842 --- ParallelTerminationStrategy: PID 16280 died... 08:49:53.318731 run iperf3-srv_10.42.42.10(pid=16280): Terminated {rc=256} 08:49:53.362627 --- ParallelTerminationStrategy: PID 16283 died... 08:49:53.381530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Terminated: ok {rc=0} 08:49:53.426257 --- ParallelTerminationStrategy: PID 16286 died... 08:49:53.445275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Terminated: ok {rc=0} 08:49:53.489399 --- ParallelTerminationStrategy: PID 16289 died... 08:49:53.508292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16289): Terminated: ok {rc=0} 08:49:53.595061 bus /gobi_4: Setting Powered False 08:49:54.695887 bus /gobi_4: Setting Powered False 08:49:55.811972 bus /gobi_1: Setting Powered False 08:49:56.912250 bus /gobi_1: Setting Powered False 08:49:58.028668 bus /gobi_0: Setting Powered False 08:49:59.125959 bus /gobi_0: Setting Powered False 08:50:00.242758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 08:50:01.372832 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:01.391602 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:50:01.478304 tst ping.py: using LAC 20312 08:50:01.638672 tst ping.py: using RAC 167 08:50:01.765408 tst ping.py: using CellId 20312 08:50:01.890280 tst ping.py: using BVCI 20313 08:50:02.008344 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:02.021799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:02.033905 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:02.045955 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:02.058022 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:02.070242 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:02.082593 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:02.094781 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:50:02.214556 tst ping.py:19: start network... 08:50:02.441347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:02.955184 run create_hlr_db(pid=16301): Launched 08:50:03.081627 bus /gobi_6: Setting Powered False 08:50:04.146124 run create_hlr_db(pid=16301): Terminated: ok {rc=0} 08:50:04.582538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16303): Launched 08:50:04.888663 run osmo-hlr_10.42.42.2(pid=16304): Launched 08:50:05.004743 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:05.534337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16306): Launched 08:50:05.838526 run osmo-stp_10.42.42.5(pid=16307): Launched 08:50:05.954334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:06.479411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16309): Launched 08:50:06.595556 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:06.853276 run patchelf(pid=16310): Launched 08:50:07.022608 run osmo-stp_10.42.42.5(pid=16307): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16307)] 08:50:07.151607 run osmo-stp_10.42.42.5(pid=16307): stdout: | (launched: 2022-12-09_08:50:05.782100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:07.281826 run osmo-stp_10.42.42.5(pid=16307): stderr: | [0;m[38;5;43m20221209085005951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085005952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085005952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085005952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085005953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085005953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085005953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:07.412508 run osmo-stp_10.42.42.5(pid=16307): stdout: | (launched: 2022-12-09_08:50:05.782100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:07.539006 run osmo-stp_10.42.42.5(pid=16307): stderr: | [0;m[38;5;43m20221209085005951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085005952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085005952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085005952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085005953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085005953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085005953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:07.687135 run patchelf(pid=16310): Terminating (SIGINT) 08:50:07.857862 run patchelf(pid=16310): Terminated: ok {rc=0} 08:50:07.980519 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16307): Process ended prematurely: osmo-stp_10.42.42.5(pid=16307) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16307)] [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 08:50:07.989554 tst ping.py:22: Test FAILED (6.6 sec) 08:50:08.016404 run osmo-hlr_10.42.42.2(pid=16304): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16304)] 08:50:08.064029 run osmo-hlr_10.42.42.2(pid=16304): stdout: | (launched: 2022-12-09_08:50:04.832251) 08:50:08.113451 run osmo-hlr_10.42.42.2(pid=16304): stderr: | [0;m[1;31m20221209085005006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085005006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085005006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085005006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085005006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085005006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085005020 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085005030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085005031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085005031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:08.163170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16303): Terminating (SIGTERM) 08:50:08.202879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16306): Terminating (SIGTERM) 08:50:08.242740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16309): Terminating (SIGTERM) 08:50:08.283023 --- ParallelTerminationStrategy: PID 16303 died... 08:50:08.302395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16303): Terminated: ok {rc=0} 08:50:08.346903 --- ParallelTerminationStrategy: PID 16306 died... 08:50:08.365924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16306): Terminated: ok {rc=0} 08:50:08.410485 --- ParallelTerminationStrategy: PID 16309 died... 08:50:08.429509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16309): Terminated: ok {rc=0} 08:50:08.516315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 08:50:09.605938 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:09.618360 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:50:09.672557 tst ping_idle_ping.py: using LAC 20313 08:50:09.798893 tst ping_idle_ping.py: using RAC 168 08:50:09.920005 tst ping_idle_ping.py: using CellId 20313 08:50:10.049753 tst ping_idle_ping.py: using BVCI 20314 08:50:10.163918 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:10.175665 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:10.187133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:10.198672 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:10.210124 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:10.221713 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:10.233494 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:50:10.244696 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:50:10.362835 tst ping_idle_ping.py:24: start network... 08:50:10.567332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:11.045155 run create_hlr_db(pid=16311): Launched 08:50:11.170946 bus /gobi_6: Setting Powered False 08:50:12.238397 run create_hlr_db(pid=16311): Terminated: ok {rc=0} 08:50:12.709637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16411): Launched 08:50:13.037704 run osmo-hlr_10.42.42.2(pid=16486): Launched 08:50:13.267141 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:13.860687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16590): Launched 08:50:14.185828 run osmo-stp_10.42.42.5(pid=16667): Launched 08:50:14.312853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:14.839678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16670): Launched 08:50:14.956468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:15.214827 run patchelf(pid=16671): Launched 08:50:15.383672 run osmo-stp_10.42.42.5(pid=16667): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16667)] 08:50:15.512572 run osmo-stp_10.42.42.5(pid=16667): stdout: | (launched: 2022-12-09_08:50:14.129533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:15.643535 run osmo-stp_10.42.42.5(pid=16667): stderr: | [0;m[38;5;43m20221209085014301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085014302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085014302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085014302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085014303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085014303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085014303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:15.773994 run osmo-stp_10.42.42.5(pid=16667): stdout: | (launched: 2022-12-09_08:50:14.129533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:15.916686 run osmo-stp_10.42.42.5(pid=16667): stderr: | [0;m[38;5;43m20221209085014301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085014302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085014302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085014302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085014303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085014303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085014303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:16.067312 run patchelf(pid=16671): Terminating (SIGINT) 08:50:16.241859 run patchelf(pid=16671): Terminated: ok {rc=0} 08:50:16.367672 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16667): Process ended prematurely: osmo-stp_10.42.42.5(pid=16667) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16667)] [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 08:50:16.377365 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:50:16.404776 run osmo-hlr_10.42.42.2(pid=16486): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16486)] 08:50:16.453712 run osmo-hlr_10.42.42.2(pid=16486): stdout: | (launched: 2022-12-09_08:50:12.977688) 08:50:16.504263 run osmo-hlr_10.42.42.2(pid=16486): stderr: | [0;m[1;31m20221209085013169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085013169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085013169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085013169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085013169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085013169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085013186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085013194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085013194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085013194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:16.554995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16411): Terminating (SIGTERM) 08:50:16.596317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16590): Terminating (SIGTERM) 08:50:16.638827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16670): Terminating (SIGTERM) 08:50:16.680164 --- ParallelTerminationStrategy: PID 16411 died... 08:50:16.699677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16411): Terminated: ok {rc=0} 08:50:16.744522 --- ParallelTerminationStrategy: PID 16590 died... 08:50:16.764102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16590): Terminated: ok {rc=0} 08:50:16.809104 --- ParallelTerminationStrategy: PID 16670 died... 08:50:16.828271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16670): Terminated: ok {rc=0} 08:50:16.915460 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:50:18.229646 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:18.236094 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:50:18.269600 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:50:18.304620 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:50:18.359470 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:50:18.393554 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:50:18.428810 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:50:18.987010 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:50:18.992044 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.003506 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:50:19.073549 tst switch_tch_pdch.py: using LAC 20314 08:50:19.195683 tst switch_tch_pdch.py: using RAC 169 08:50:19.316718 tst switch_tch_pdch.py: using CellId 20314 08:50:19.438078 tst switch_tch_pdch.py: using BVCI 20315 08:50:19.550083 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.561597 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.572757 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.584074 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.595730 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.606946 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.618630 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:50:19.629888 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:19.748663 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:19.871574 tst switch_tch_pdch.py:51: start network... 08:50:20.093114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:20.599284 run create_hlr_db(pid=16677): Launched 08:50:20.724250 bus /gobi_6: Setting Powered False 08:50:21.788939 run create_hlr_db(pid=16677): Terminated: ok {rc=0} 08:50:22.244262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16679): Launched 08:50:22.579759 run osmo-hlr_10.42.42.2(pid=16690): Launched 08:50:22.716309 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:23.434017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16851): Launched 08:50:23.760321 run osmo-stp_10.42.42.5(pid=16858): Launched 08:50:24.013775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:24.653202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16860): Launched 08:50:24.789157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:25.068316 run patchelf(pid=16861): Launched 08:50:25.264610 run osmo-stp_10.42.42.5(pid=16858): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16858)] 08:50:25.405274 run osmo-stp_10.42.42.5(pid=16858): stdout: | (launched: 2022-12-09_08:50:23.700565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:25.547818 run osmo-stp_10.42.42.5(pid=16858): stderr: | [0;m[38;5;43m20221209085023994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085023994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085023994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085023995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085023995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085023995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085023995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:25.690446 run osmo-stp_10.42.42.5(pid=16858): stdout: | (launched: 2022-12-09_08:50:23.700565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:25.827331 run osmo-stp_10.42.42.5(pid=16858): stderr: | [0;m[38;5;43m20221209085023994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085023994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085023994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085023995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085023995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085023995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085023995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:25.989507 run patchelf(pid=16861): Terminating (SIGINT) 08:50:26.175631 run patchelf(pid=16861): Terminated: ok {rc=0} 08:50:26.310166 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16858): Process ended prematurely: osmo-stp_10.42.42.5(pid=16858) [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16858)] [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:50:26.320771 tst switch_tch_pdch.py:54: Test FAILED (7.3 sec) 08:50:26.352543 run osmo-hlr_10.42.42.2(pid=16690): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16690)] 08:50:26.405661 run osmo-hlr_10.42.42.2(pid=16690): stdout: | (launched: 2022-12-09_08:50:22.517867) 08:50:26.460114 run osmo-hlr_10.42.42.2(pid=16690): stderr: | [0;m[1;31m20221209085022857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085022857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085022857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085022857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085022857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085022857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085022879 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085022894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085022895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085022895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:26.515066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16679): Terminating (SIGTERM) 08:50:26.560048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16851): Terminating (SIGTERM) 08:50:26.606603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16860): Terminating (SIGTERM) 08:50:26.653214 --- ParallelTerminationStrategy: PID 16679 died... 08:50:26.674303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16679): Terminated: ok {rc=0} 08:50:26.725324 --- ParallelTerminationStrategy: PID 16851 died... 08:50:26.746074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16851): Terminated: ok {rc=0} 08:50:26.795831 --- ParallelTerminationStrategy: PID 16860 died... 08:50:26.816679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16860): Terminated: ok {rc=0} 08:50:26.909444 bus /gobi_0: Setting Powered False 08:50:28.012106 bus /gobi_0: Setting Powered False 08:50:29.129400 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:50:30.388892 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:30.395278 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:50:30.430946 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:50:30.467220 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:50:30.522347 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:50:30.557244 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:50:30.593854 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:50:31.184027 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:50:31.192546 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.210160 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:50:31.295175 tst switch_tch_pdch.py: using LAC 20315 08:50:31.454136 tst switch_tch_pdch.py: using RAC 170 08:50:31.577898 tst switch_tch_pdch.py: using CellId 20315 08:50:31.706812 tst switch_tch_pdch.py: using BVCI 20316 08:50:31.828399 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.841070 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.853489 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.867840 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.881342 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.895002 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.908625 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:50:31.921126 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:50:32.065760 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:50:32.205573 tst switch_tch_pdch.py:51: start network... 08:50:32.425298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:32.903295 run create_hlr_db(pid=16866): Launched 08:50:33.027635 bus /gobi_6: Setting Powered False 08:50:34.092368 run create_hlr_db(pid=16866): Terminated: ok {rc=0} 08:50:34.502271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16868): Launched 08:50:34.807560 run osmo-hlr_10.42.42.2(pid=16869): Launched 08:50:34.923111 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:35.425948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16871): Launched 08:50:35.755275 run osmo-stp_10.42.42.5(pid=16872): Launched 08:50:35.879706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:50:36.415671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16874): Launched 08:50:36.541454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:50:36.817920 run patchelf(pid=16875): Launched 08:50:37.000686 run osmo-stp_10.42.42.5(pid=16872): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16872)] 08:50:37.139065 run osmo-stp_10.42.42.5(pid=16872): stdout: | (launched: 2022-12-09_08:50:35.694408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:37.279048 run osmo-stp_10.42.42.5(pid=16872): stderr: | [0;m[38;5;43m20221209085035886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085035886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085035886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085035887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085035887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085035887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085035887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:37.419309 run osmo-stp_10.42.42.5(pid=16872): stdout: | (launched: 2022-12-09_08:50:35.694408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:37.553379 run osmo-stp_10.42.42.5(pid=16872): stderr: | [0;m[38;5;43m20221209085035886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085035886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085035886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085035887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085035887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085035887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085035887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:37.712028 run patchelf(pid=16875): Terminating (SIGINT) 08:50:37.894636 run patchelf(pid=16875): Terminated: ok {rc=0} 08:50:38.026728 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16872): Process ended prematurely: osmo-stp_10.42.42.5(pid=16872) [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16872)] [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:50:38.036343 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 08:50:38.065197 run osmo-hlr_10.42.42.2(pid=16869): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16869)] 08:50:38.115713 run osmo-hlr_10.42.42.2(pid=16869): stdout: | (launched: 2022-12-09_08:50:34.751430) 08:50:38.167985 run osmo-hlr_10.42.42.2(pid=16869): stderr: | [0;m[1;31m20221209085034926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085034926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085034926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085034926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085034926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085034926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085034938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085034949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085034950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085034950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:38.220842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16868): Terminating (SIGTERM) 08:50:38.263097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16871): Terminating (SIGTERM) 08:50:38.305301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16874): Terminating (SIGTERM) 08:50:38.347753 --- ParallelTerminationStrategy: PID 16868 died... 08:50:38.367847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16868): Terminated: ok {rc=0} 08:50:38.414725 --- ParallelTerminationStrategy: PID 16871 died... 08:50:38.434365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16871): Terminated: ok {rc=0} 08:50:38.480913 --- ParallelTerminationStrategy: PID 16874 died... 08:50:38.500542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16874): Terminated: ok {rc=0} 08:50:38.589528 bus /gobi_0: Setting Powered False 08:50:39.687992 bus /gobi_0: Setting Powered False 08:50:40.804884 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 08:50:42.064027 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:42.067936 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:50:42.102503 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 08:50:42.109355 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:50:42.160174 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:50:42.194039 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 08:50:42.200740 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:50:42.742203 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 08:50:42.747033 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 08:50:42.758085 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:50:42.806609 tst mo_mt_sms.py: using LAC 20316 08:50:42.926257 tst mo_mt_sms.py: using RAC 171 08:50:43.045936 tst mo_mt_sms.py: using CellId 20316 08:50:43.164418 tst mo_mt_sms.py: using BVCI 20317 08:50:43.274314 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:50:43.393868 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:50:43.509632 tst mo_mt_sms.py:9: start nitb and bts... 08:50:43.715713 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:50:44.340059 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16879): Launched 08:50:44.645974 run osmo-nitb_10.42.42.2(pid=16880): Launched 08:50:44.817437 run osmo-nitb_10.42.42.2(pid=16880): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16880)] 08:50:44.954030 run osmo-nitb_10.42.42.2(pid=16880): stdout: | (launched: 2022-12-09_08:50:44.589676) 08:50:45.092225 run osmo-nitb_10.42.42.2(pid=16880): stderr: | (launched: 2022-12-09_08:50:44.635166) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:50:45.230375 run osmo-nitb_10.42.42.2(pid=16880): stdout: | (launched: 2022-12-09_08:50:44.589676) 08:50:45.362795 run osmo-nitb_10.42.42.2(pid=16880): stderr: | (launched: 2022-12-09_08:50:44.635166) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16880) [trial-2357↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16880)] 08:50:45.763265 tst osmo-nitb_10.42.42.2(pid=16880): stdout: | (launched: 2022-12-09_08:50:44.589676) 08:50:45.903469 tst osmo-nitb_10.42.42.2(pid=16880): stderr: | (launched: 2022-12-09_08:50:44.635166) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:50:46.064277 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16880) [trial-2357↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16880)] [trial-2357↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 08:50:46.074538 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 08:50:46.082856 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16879): Terminating (SIGTERM) 08:50:46.299790 --- ParallelTerminationStrategy: PID 16879 died... 08:50:46.318972 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16879): Terminated: ok {rc=0} 08:50:46.407834 bus /sierra_3: Setting Powered False 08:50:47.506409 bus /sierra_3: Setting Powered False 08:50:48.624206 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:trx-sysmocell5000 --------------------------------------------------------------------- 08:50:49.826743 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:49.830800 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:50:49.865663 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:50:49.892850 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:50:49.945100 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:50:49.979028 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:50:50.005835 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:50:50.556647 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 08:50:50.561567 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:50:50.572441 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:50:50.620694 tst mo_mt_sms.py: using LAC 20317 08:50:50.740109 tst mo_mt_sms.py: using RAC 172 08:50:50.860268 tst mo_mt_sms.py: using CellId 20317 08:50:50.982910 tst mo_mt_sms.py: using BVCI 20318 08:50:51.095674 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:50:51.106626 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:50:51.117579 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:50:51.128217 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:50:51.138915 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:50:51.149626 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:50:51.267571 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:50:51.388410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:51.864802 run create_hlr_db(pid=16884): Launched 08:50:51.993057 bus /sierra_2: Setting Powered False 08:50:53.053956 run create_hlr_db(pid=16884): Terminated: ok {rc=0} 08:50:53.501386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16886): Launched 08:50:53.828447 run osmo-hlr_10.42.42.2(pid=16887): Launched 08:50:53.953787 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:54.517122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16889): Launched 08:50:54.844177 run osmo-stp_10.42.42.5(pid=16890): Launched 08:50:54.969267 run osmo-msc_10.42.42.6: Starting osmo-msc 08:50:55.560058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16892): Launched 08:50:55.886105 run osmo-msc_10.42.42.6(pid=16893): Launched 08:50:56.070111 run osmo-stp_10.42.42.5(pid=16890): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16890)] 08:50:56.208792 run osmo-stp_10.42.42.5(pid=16890): stdout: | (launched: 2022-12-09_08:50:54.784104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:56.347526 run osmo-stp_10.42.42.5(pid=16890): stderr: | [0;m[38;5;43m20221209085054974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085054974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085054974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085054975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085054975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085054975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085054975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:56.483612 run osmo-stp_10.42.42.5(pid=16890): stdout: | (launched: 2022-12-09_08:50:54.784104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:56.613300 run osmo-stp_10.42.42.5(pid=16890): stderr: | [0;m[38;5;43m20221209085054974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085054974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085054974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085054975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085054975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085054975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085054975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:56.768087 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16890): Process ended prematurely: osmo-stp_10.42.42.5(pid=16890) [trial-2357↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16890)] [trial-2357↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 08:50:56.777083 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 08:50:56.805352 run osmo-hlr_10.42.42.2(pid=16887): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16887)] 08:50:56.856673 run osmo-hlr_10.42.42.2(pid=16887): stdout: | (launched: 2022-12-09_08:50:53.768780) 08:50:56.909661 run osmo-hlr_10.42.42.2(pid=16887): stderr: | [0;m[1;31m20221209085053966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085053966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085053966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085053966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085053966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085053966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085053978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085053989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085053989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085053989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:56.983062 run osmo-msc_10.42.42.6(pid=16893): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16893)] 08:50:57.034545 run osmo-msc_10.42.42.6(pid=16893): stdout: | (launched: 2022-12-09_08:50:55.826047) 08:50:57.087384 run osmo-msc_10.42.42.6(pid=16893): stderr: | [0;m[38;5;43m20221209085056147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085056147 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a590fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085056147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085056147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085056148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085056148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085056149 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085056150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085056150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085056150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:50:57.140642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16886): Terminating (SIGTERM) 08:50:57.183278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16889): Terminating (SIGTERM) 08:50:57.226035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16892): Terminating (SIGTERM) 08:50:57.268599 --- ParallelTerminationStrategy: PID 16886 died... 08:50:57.288757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16886): Terminated: ok {rc=0} 08:50:57.336253 --- ParallelTerminationStrategy: PID 16889 died... 08:50:57.356178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16889): Terminated: ok {rc=0} 08:50:57.403053 --- ParallelTerminationStrategy: PID 16892 died... 08:50:57.422941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16892): Terminated: ok {rc=0} 08:50:57.511059 bus /sierra_3: Setting Powered False 08:50:58.610078 bus /sierra_3: Setting Powered False 08:50:59.724490 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 08:51:00.993089 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:00.998401 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:51:01.041137 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 08:51:01.052690 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 08:51:01.164563 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:51:01.214524 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 08:51:01.225733 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 08:51:01.677119 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 08:51:01.687491 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 08:51:01.703327 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:51:01.763567 tst assert_extension.py: using LAC 20318 08:51:01.885289 tst assert_extension.py: using RAC 173 08:51:02.050120 tst assert_extension.py: using CellId 20318 08:51:02.180720 tst assert_extension.py: using BVCI 20319 08:51:02.335075 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 08:51:02.460912 tst assert_extension.py:10: start nitb and bts... 08:51:02.681526 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:51:03.350785 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16898): Launched 08:51:03.680704 run osmo-nitb_10.42.42.2(pid=16899): Launched 08:51:03.863109 run osmo-nitb_10.42.42.2(pid=16899): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16899)] 08:51:04.010112 run osmo-nitb_10.42.42.2(pid=16899): stdout: | (launched: 2022-12-09_08:51:03.620782) 08:51:04.159717 run osmo-nitb_10.42.42.2(pid=16899): stderr: | (launched: 2022-12-09_08:51:03.669728) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:51:04.307676 run osmo-nitb_10.42.42.2(pid=16899): stdout: | (launched: 2022-12-09_08:51:03.620782) 08:51:04.450996 run osmo-nitb_10.42.42.2(pid=16899): stderr: | (launched: 2022-12-09_08:51:03.669728) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16899): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16899) [trial-2357↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16899)] 08:51:04.805272 tst osmo-nitb_10.42.42.2(pid=16899): stdout: | (launched: 2022-12-09_08:51:03.620782) 08:51:04.938205 tst osmo-nitb_10.42.42.2(pid=16899): stderr: | (launched: 2022-12-09_08:51:03.669728) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:51:05.095202 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16899): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16899) [trial-2357↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16899)] [trial-2357↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 08:51:05.104495 tst assert_extension.py:12: Test FAILED (3.4 sec) 08:51:05.111850 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16898): Terminating (SIGTERM) 08:51:05.325739 --- ParallelTerminationStrategy: PID 16898 died... 08:51:05.347287 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16898): Terminated: ok {rc=0} 08:51:05.438879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 08:51:06.621862 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:06.626455 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:51:06.663557 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:51:06.691905 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 08:51:06.728135 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:51:06.764272 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:51:06.792688 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 08:51:07.325905 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 08:51:07.331364 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:07.343026 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:51:07.395281 tst assert_extension.py: using LAC 20319 08:51:07.524438 tst assert_extension.py: using RAC 174 08:51:07.645763 tst assert_extension.py: using CellId 20319 08:51:07.775395 tst assert_extension.py: using BVCI 20320 08:51:07.893747 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:07.905702 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:07.917214 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:07.928794 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:07.940562 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:07.952451 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 08:51:08.072005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:08.579420 run create_hlr_db(pid=16903): Launched 08:51:08.704000 bus /sierra_2: Setting Powered False 08:51:09.768732 run create_hlr_db(pid=16903): Terminated: ok {rc=0} 08:51:10.206667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16905): Launched 08:51:10.511591 run osmo-hlr_10.42.42.2(pid=16906): Launched 08:51:10.628605 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:11.274976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16908): Launched 08:51:11.576798 run osmo-stp_10.42.42.5(pid=16909): Launched 08:51:11.693309 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:12.236550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16911): Launched 08:51:12.537672 run osmo-msc_10.42.42.6(pid=16912): Launched 08:51:12.705996 run osmo-stp_10.42.42.5(pid=16909): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16909)] 08:51:12.833331 run osmo-stp_10.42.42.5(pid=16909): stdout: | (launched: 2022-12-09_08:51:11.520836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:12.960300 run osmo-stp_10.42.42.5(pid=16909): stderr: | [0;m[38;5;43m20221209085111691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085111691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085111691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085111692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085111692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085111692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085111693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:13.085559 run osmo-stp_10.42.42.5(pid=16909): stdout: | (launched: 2022-12-09_08:51:11.520836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:13.204840 run osmo-stp_10.42.42.5(pid=16909): stderr: | [0;m[38;5;43m20221209085111691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085111691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085111691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085111692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085111692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085111692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085111693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:13.347956 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16909): Process ended prematurely: osmo-stp_10.42.42.5(pid=16909) [trial-2357↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16909)] [trial-2357↪ussd:trx-sysmocell5000↪assert_extension.py:17] 08:51:13.356481 tst assert_extension.py:17: Test FAILED (6.0 sec) 08:51:13.382909 run osmo-hlr_10.42.42.2(pid=16906): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16906)] 08:51:13.431362 run osmo-hlr_10.42.42.2(pid=16906): stdout: | (launched: 2022-12-09_08:51:10.455299) 08:51:13.481505 run osmo-hlr_10.42.42.2(pid=16906): stderr: | [0;m[1;31m20221209085110631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085110631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085110631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085110631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085110631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085110631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085110644 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085110654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085110654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085110654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:13.551388 run osmo-msc_10.42.42.6(pid=16912): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16912)] 08:51:13.599805 run osmo-msc_10.42.42.6(pid=16912): stdout: | (launched: 2022-12-09_08:51:12.482073) 08:51:13.649451 run osmo-msc_10.42.42.6(pid=16912): stderr: | [0;m[38;5;43m20221209085112752 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085112752 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbe1558fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085112752 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085112752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085112752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085112753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085112754 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085112755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085112755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085112755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:13.699738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16905): Terminating (SIGTERM) 08:51:13.740073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16908): Terminating (SIGTERM) 08:51:13.780559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16911): Terminating (SIGTERM) 08:51:13.821223 --- ParallelTerminationStrategy: PID 16905 died... 08:51:13.840403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16905): Terminated: ok {rc=0} 08:51:13.884666 --- ParallelTerminationStrategy: PID 16908 died... 08:51:13.903723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16908): Terminated: ok {rc=0} 08:51:13.947820 --- ParallelTerminationStrategy: PID 16911 died... 08:51:13.966462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16911): Terminated: ok {rc=0} 08:51:14.052585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:51:15.268518 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:15.277116 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:51:15.313458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:51:15.341422 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:51:15.396267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:51:15.431816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:51:15.459394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:51:16.030918 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:51:16.087376 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:16.099915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:51:16.173034 tst mo_mt_call.py: using LAC 20320 08:51:16.336083 tst mo_mt_call.py: using RAC 175 08:51:16.462713 tst mo_mt_call.py: using CellId 20320 08:51:16.622148 tst mo_mt_call.py: using BVCI 20321 08:51:16.774702 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:16.790235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:16.806189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:16.822261 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:16.837193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:16.852880 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:16.999841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:17.147944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:17.632450 run create_hlr_db(pid=16917): Launched 08:51:17.758057 bus /sierra_2: Setting Powered False 08:51:18.819035 run create_hlr_db(pid=16917): Terminated: ok {rc=0} 08:51:19.266083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16919): Launched 08:51:19.593854 run osmo-hlr_10.42.42.2(pid=16920): Launched 08:51:19.721049 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:20.288409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16922): Launched 08:51:20.615902 run osmo-stp_10.42.42.5(pid=16923): Launched 08:51:20.742288 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:21.335478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16925): Launched 08:51:21.664902 run osmo-msc_10.42.42.6(pid=16926): Launched 08:51:21.851271 run osmo-stp_10.42.42.5(pid=16923): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16923)] 08:51:22.038467 run osmo-stp_10.42.42.5(pid=16923): stdout: | (launched: 2022-12-09_08:51:20.555803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:22.177795 run osmo-stp_10.42.42.5(pid=16923): stderr: | [0;m[38;5;43m20221209085120747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085120747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085120747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085120748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085120748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085120748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085120748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:22.314538 run osmo-stp_10.42.42.5(pid=16923): stdout: | (launched: 2022-12-09_08:51:20.555803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:22.445610 run osmo-stp_10.42.42.5(pid=16923): stderr: | [0;m[38;5;43m20221209085120747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085120747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085120747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085120748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085120748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085120748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085120748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:22.602792 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16923): Process ended prematurely: osmo-stp_10.42.42.5(pid=16923) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16923)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:51:22.612413 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:51:22.640731 run osmo-hlr_10.42.42.2(pid=16920): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16920)] 08:51:22.691751 run osmo-hlr_10.42.42.2(pid=16920): stdout: | (launched: 2022-12-09_08:51:19.534317) 08:51:22.744459 run osmo-hlr_10.42.42.2(pid=16920): stderr: | [0;m[1;31m20221209085119730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085119730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085119731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085119731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085119731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085119731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085119743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085119752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085119752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085119752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:22.817931 run osmo-msc_10.42.42.6(pid=16926): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16926)] 08:51:22.868706 run osmo-msc_10.42.42.6(pid=16926): stdout: | (launched: 2022-12-09_08:51:21.605307) 08:51:22.921215 run osmo-msc_10.42.42.6(pid=16926): stderr: | [0;m[38;5;43m20221209085121940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085121940 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f55e2e0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085121940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085121947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085121947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085121948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085121949 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085121950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085121950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085121950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:22.974104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16919): Terminating (SIGTERM) 08:51:23.016287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16922): Terminating (SIGTERM) 08:51:23.059562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16925): Terminating (SIGTERM) 08:51:23.102291 --- ParallelTerminationStrategy: PID 16919 died... 08:51:23.122330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16919): Terminated: ok {rc=0} 08:51:23.169256 --- ParallelTerminationStrategy: PID 16922 died... 08:51:23.188841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16922): Terminated: ok {rc=0} 08:51:23.235345 --- ParallelTerminationStrategy: PID 16925 died... 08:51:23.254837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16925): Terminated: ok {rc=0} 08:51:23.343829 bus /sierra_3: Setting Powered False 08:51:24.444190 bus /sierra_3: Setting Powered False 08:51:25.561780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:51:26.712002 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:26.724589 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:51:26.802011 tst mo_mt_call_osmux.py: using LAC 20321 08:51:26.930736 tst mo_mt_call_osmux.py: using RAC 176 08:51:27.061840 tst mo_mt_call_osmux.py: using CellId 20321 08:51:27.190178 tst mo_mt_call_osmux.py: using BVCI 20322 08:51:27.309724 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:27.321636 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:27.333461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:27.345478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:27.357590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:51:27.369763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:27.488836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:51:27.609792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:28.087799 run create_hlr_db(pid=16928): Launched 08:51:28.217244 bus /sierra_2: Setting Powered False 08:51:29.282358 run create_hlr_db(pid=16928): Terminated: ok {rc=0} 08:51:29.738488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16930): Launched 08:51:30.066843 run osmo-hlr_10.42.42.2(pid=16931): Launched 08:51:30.194999 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:30.760521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16933): Launched 08:51:31.125701 run osmo-stp_10.42.42.5(pid=16934): Launched 08:51:31.338620 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:32.036852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16936): Launched 08:51:32.373708 run osmo-msc_10.42.42.6(pid=16937): Launched 08:51:32.569861 run osmo-stp_10.42.42.5(pid=16934): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16934)] 08:51:32.710158 run osmo-stp_10.42.42.5(pid=16934): stdout: | (launched: 2022-12-09_08:51:31.061866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:32.850681 run osmo-stp_10.42.42.5(pid=16934): stderr: | [0;m[38;5;43m20221209085131422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085131425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085131426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085131426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085131427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085131427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085131427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:32.990288 run osmo-stp_10.42.42.5(pid=16934): stdout: | (launched: 2022-12-09_08:51:31.061866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:33.122996 run osmo-stp_10.42.42.5(pid=16934): stderr: | [0;m[38;5;43m20221209085131422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085131425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085131426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085131426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085131427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085131427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085131427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:33.280346 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16934): Process ended prematurely: osmo-stp_10.42.42.5(pid=16934) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16934)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:51:33.290255 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:51:33.318934 run osmo-hlr_10.42.42.2(pid=16931): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16931)] 08:51:33.370094 run osmo-hlr_10.42.42.2(pid=16931): stdout: | (launched: 2022-12-09_08:51:30.006632) 08:51:33.423030 run osmo-hlr_10.42.42.2(pid=16931): stderr: | [0;m[1;31m20221209085130205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085130205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085130205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085130205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085130206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085130206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085130218 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085130226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085130227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085130227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:33.496621 run osmo-msc_10.42.42.6(pid=16937): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16937)] 08:51:33.547794 run osmo-msc_10.42.42.6(pid=16937): stdout: | (launched: 2022-12-09_08:51:32.309225) 08:51:33.600427 run osmo-msc_10.42.42.6(pid=16937): stderr: | [0;m[38;5;43m20221209085132695 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085132695 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5e2ef0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085132695 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085132696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085132696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085132696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085132698 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085132698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085132698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085132698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:33.653419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16930): Terminating (SIGTERM) 08:51:33.696197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16933): Terminating (SIGTERM) 08:51:33.739134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16936): Terminating (SIGTERM) 08:51:33.782324 --- ParallelTerminationStrategy: PID 16930 died... 08:51:33.802477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16930): Terminated: ok {rc=0} 08:51:33.849912 --- ParallelTerminationStrategy: PID 16933 died... 08:51:33.869631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16933): Terminated: ok {rc=0} 08:51:33.916634 --- ParallelTerminationStrategy: PID 16936 died... 08:51:33.936444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16936): Terminated: ok {rc=0} 08:51:34.025654 bus /sierra_3: Setting Powered False 08:51:35.126336 bus /sierra_3: Setting Powered False 08:51:36.243631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:51:37.498007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:37.504363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:51:37.539138 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:51:37.566440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:51:37.618906 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:51:37.653492 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:51:37.680730 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:51:38.238053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:51:38.291174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:38.303054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:51:38.374722 tst mo_mt_call.py: using LAC 20322 08:51:38.501367 tst mo_mt_call.py: using RAC 177 08:51:38.628383 tst mo_mt_call.py: using CellId 20322 08:51:38.755050 tst mo_mt_call.py: using BVCI 20323 08:51:38.867297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:38.878909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:38.890484 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:38.902155 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:38.913898 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:38.925395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:51:39.046777 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:51:39.164682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:39.642326 run create_hlr_db(pid=16942): Launched 08:51:39.767125 bus /sierra_2: Setting Powered False 08:51:40.828578 run create_hlr_db(pid=16942): Terminated: ok {rc=0} 08:51:41.277283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16944): Launched 08:51:41.605082 run osmo-hlr_10.42.42.2(pid=16945): Launched 08:51:41.730195 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:42.299983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16947): Launched 08:51:42.627690 run osmo-stp_10.42.42.5(pid=16948): Launched 08:51:42.753790 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:43.354077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16950): Launched 08:51:43.683802 run osmo-msc_10.42.42.6(pid=16951): Launched 08:51:43.867741 run osmo-stp_10.42.42.5(pid=16948): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16948)] 08:51:44.007006 run osmo-stp_10.42.42.5(pid=16948): stdout: | (launched: 2022-12-09_08:51:42.567773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:44.147214 run osmo-stp_10.42.42.5(pid=16948): stderr: | [0;m[38;5;43m20221209085142760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085142760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085142760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085142761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085142761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085142761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085142761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:44.285114 run osmo-stp_10.42.42.5(pid=16948): stdout: | (launched: 2022-12-09_08:51:42.567773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:44.417141 run osmo-stp_10.42.42.5(pid=16948): stderr: | [0;m[38;5;43m20221209085142760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085142760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085142760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085142761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085142761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085142761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085142761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:44.574598 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16948): Process ended prematurely: osmo-stp_10.42.42.5(pid=16948) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16948)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:51:44.584474 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:51:44.613227 run osmo-hlr_10.42.42.2(pid=16945): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16945)] 08:51:44.664025 run osmo-hlr_10.42.42.2(pid=16945): stdout: | (launched: 2022-12-09_08:51:41.545011) 08:51:44.716550 run osmo-hlr_10.42.42.2(pid=16945): stderr: | [0;m[1;31m20221209085141744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085141744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085141744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085141744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085141744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085141744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085141757 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085141766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085141766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085141766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:44.789441 run osmo-msc_10.42.42.6(pid=16951): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16951)] 08:51:44.840053 run osmo-msc_10.42.42.6(pid=16951): stdout: | (launched: 2022-12-09_08:51:43.623479) 08:51:44.892456 run osmo-msc_10.42.42.6(pid=16951): stderr: | [0;m[38;5;43m20221209085143945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085143945 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f57e4cb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085143945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085143945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085143945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085143945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085143947 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085143947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085143947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085143948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:44.945388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16944): Terminating (SIGTERM) 08:51:44.987646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16947): Terminating (SIGTERM) 08:51:45.029829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16950): Terminating (SIGTERM) 08:51:45.072667 --- ParallelTerminationStrategy: PID 16944 died... 08:51:45.092871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16944): Terminated: ok {rc=0} 08:51:45.140392 --- ParallelTerminationStrategy: PID 16947 died... 08:51:45.160216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16947): Terminated: ok {rc=0} 08:51:45.206949 --- ParallelTerminationStrategy: PID 16950 died... 08:51:45.226729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16950): Terminated: ok {rc=0} 08:51:45.316246 bus /sierra_3: Setting Powered False 08:51:46.423659 bus /sierra_3: Setting Powered False 08:51:47.556554 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:51:48.703860 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:48.716310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:51:48.787805 tst mo_mt_call_osmux.py: using LAC 20323 08:51:48.909361 tst mo_mt_call_osmux.py: using RAC 178 08:51:49.029677 tst mo_mt_call_osmux.py: using CellId 20323 08:51:49.152239 tst mo_mt_call_osmux.py: using BVCI 20324 08:51:49.265639 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:49.277175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:49.288317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:49.300031 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:49.311540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:51:49.323053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:51:49.445806 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:51:49.565679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:50.043067 run create_hlr_db(pid=16953): Launched 08:51:50.167599 bus /sierra_2: Setting Powered False 08:51:51.229079 run create_hlr_db(pid=16953): Terminated: ok {rc=0} 08:51:51.675358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16955): Launched 08:51:52.005529 run osmo-hlr_10.42.42.2(pid=16956): Launched 08:51:52.131909 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:52.697946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16958): Launched 08:51:53.026342 run osmo-stp_10.42.42.5(pid=16959): Launched 08:51:53.152593 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:53.746373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16961): Launched 08:51:54.077192 run osmo-msc_10.42.42.6(pid=16962): Launched 08:51:54.261387 run osmo-stp_10.42.42.5(pid=16959): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16959)] 08:51:54.400315 run osmo-stp_10.42.42.5(pid=16959): stdout: | (launched: 2022-12-09_08:51:52.966091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:54.539580 run osmo-stp_10.42.42.5(pid=16959): stderr: | [0;m[38;5;43m20221209085153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085153160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085153160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085153160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085153160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:54.677340 run osmo-stp_10.42.42.5(pid=16959): stdout: | (launched: 2022-12-09_08:51:52.966091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:54.809118 run osmo-stp_10.42.42.5(pid=16959): stderr: | [0;m[38;5;43m20221209085153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085153159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085153160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085153160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085153160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085153160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:54.966595 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16959): Process ended prematurely: osmo-stp_10.42.42.5(pid=16959) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16959)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:51:54.976409 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:51:55.004872 run osmo-hlr_10.42.42.2(pid=16956): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16956)] 08:51:55.055606 run osmo-hlr_10.42.42.2(pid=16956): stdout: | (launched: 2022-12-09_08:51:51.945427) 08:51:55.107835 run osmo-hlr_10.42.42.2(pid=16956): stderr: | [0;m[1;31m20221209085152144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085152144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085152144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085152144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085152144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085152145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085152157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085152165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085152166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085152166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:55.180445 run osmo-msc_10.42.42.6(pid=16962): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16962)] 08:51:55.230583 run osmo-msc_10.42.42.6(pid=16962): stdout: | (launched: 2022-12-09_08:51:54.016425) 08:51:55.282395 run osmo-msc_10.42.42.6(pid=16962): stderr: | [0;m[38;5;43m20221209085154339 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085154339 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdbef3e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085154339 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085154339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085154339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085154339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085154341 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085154342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085154342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085154342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:55.334875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16955): Terminating (SIGTERM) 08:51:55.377058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16958): Terminating (SIGTERM) 08:51:55.419427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16961): Terminating (SIGTERM) 08:51:55.462074 --- ParallelTerminationStrategy: PID 16955 died... 08:51:55.482178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16955): Terminated: ok {rc=0} 08:51:55.529344 --- ParallelTerminationStrategy: PID 16958 died... 08:51:55.548919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16958): Terminated: ok {rc=0} 08:51:55.595525 --- ParallelTerminationStrategy: PID 16961 died... 08:51:55.615234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16961): Terminated: ok {rc=0} 08:51:55.703661 bus /sierra_3: Setting Powered False 08:51:56.799219 bus /sierra_3: Setting Powered False 08:51:57.915447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:51:59.174257 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:59.181924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:51:59.215924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:51:59.243035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:51:59.296858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:51:59.331921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:51:59.359168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:51:59.910795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:51:59.960084 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:51:59.971793 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:52:00.043307 tst mo_mt_call.py: using LAC 20324 08:52:00.166646 tst mo_mt_call.py: using RAC 179 08:52:00.289334 tst mo_mt_call.py: using CellId 20324 08:52:00.410344 tst mo_mt_call.py: using BVCI 20325 08:52:00.522053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:00.533638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:00.544834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:00.556277 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:00.567669 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:00.579050 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:00.699504 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:00.819753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:01.323658 run create_hlr_db(pid=16967): Launched 08:52:01.491175 bus /sierra_2: Setting Powered False 08:52:02.555790 run create_hlr_db(pid=16967): Terminated: ok {rc=0} 08:52:02.996914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16969): Launched 08:52:03.304730 run osmo-hlr_10.42.42.2(pid=16970): Launched 08:52:03.421742 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:03.951064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16972): Launched 08:52:04.258839 run osmo-stp_10.42.42.5(pid=16973): Launched 08:52:04.376110 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:04.933246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16975): Launched 08:52:05.241534 run osmo-msc_10.42.42.6(pid=16976): Launched 08:52:05.413497 run osmo-stp_10.42.42.5(pid=16973): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16973)] 08:52:05.543187 run osmo-stp_10.42.42.5(pid=16973): stdout: | (launched: 2022-12-09_08:52:04.202487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:05.672812 run osmo-stp_10.42.42.5(pid=16973): stderr: | [0;m[38;5;43m20221209085204374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085204374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085204375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085204375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085204376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085204376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085204376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:05.800812 run osmo-stp_10.42.42.5(pid=16973): stdout: | (launched: 2022-12-09_08:52:04.202487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:05.923966 run osmo-stp_10.42.42.5(pid=16973): stderr: | [0;m[38;5;43m20221209085204374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085204374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085204375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085204375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085204376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085204376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085204376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:06.071215 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16973): Process ended prematurely: osmo-stp_10.42.42.5(pid=16973) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16973)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:52:06.080401 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:52:06.107111 run osmo-hlr_10.42.42.2(pid=16970): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16970)] 08:52:06.155594 run osmo-hlr_10.42.42.2(pid=16970): stdout: | (launched: 2022-12-09_08:52:03.248351) 08:52:06.205758 run osmo-hlr_10.42.42.2(pid=16970): stderr: | [0;m[1;31m20221209085203424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085203424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085203424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085203424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085203424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085203424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085203439 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085203448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085203448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085203448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:06.275663 run osmo-msc_10.42.42.6(pid=16976): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16976)] 08:52:06.323723 run osmo-msc_10.42.42.6(pid=16976): stdout: | (launched: 2022-12-09_08:52:05.184914) 08:52:06.373476 run osmo-msc_10.42.42.6(pid=16976): stderr: | [0;m[38;5;43m20221209085205458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085205458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d9929dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085205458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085205458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085205458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085205458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085205460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085205461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085205461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085205461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:06.423522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16969): Terminating (SIGTERM) 08:52:06.463893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16972): Terminating (SIGTERM) 08:52:06.503855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16975): Terminating (SIGTERM) 08:52:06.544310 --- ParallelTerminationStrategy: PID 16969 died... 08:52:06.563591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16969): Terminated: ok {rc=0} 08:52:06.608432 --- ParallelTerminationStrategy: PID 16972 died... 08:52:06.628150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16972): Terminated: ok {rc=0} 08:52:06.672682 --- ParallelTerminationStrategy: PID 16975 died... 08:52:06.691648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16975): Terminated: ok {rc=0} 08:52:06.776364 bus /sierra_3: Setting Powered False 08:52:07.874476 bus /sierra_3: Setting Powered False 08:52:08.990783 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:52:10.138085 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:10.150425 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:52:10.224546 tst mo_mt_call_osmux.py: using LAC 20325 08:52:10.345464 tst mo_mt_call_osmux.py: using RAC 180 08:52:10.467280 tst mo_mt_call_osmux.py: using CellId 20325 08:52:10.587983 tst mo_mt_call_osmux.py: using BVCI 20326 08:52:10.709450 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:10.721379 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:10.733081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:10.744937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:10.757167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:52:10.769498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:10.887807 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:52:11.006102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:11.486356 run create_hlr_db(pid=16978): Launched 08:52:11.615048 bus /sierra_2: Setting Powered False 08:52:12.676366 run create_hlr_db(pid=16978): Terminated: ok {rc=0} 08:52:13.107320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16980): Launched 08:52:13.416501 run osmo-hlr_10.42.42.2(pid=16981): Launched 08:52:13.534129 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:14.065540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16983): Launched 08:52:14.375078 run osmo-stp_10.42.42.5(pid=16984): Launched 08:52:14.492547 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:15.051863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16986): Launched 08:52:15.361362 run osmo-msc_10.42.42.6(pid=16987): Launched 08:52:15.534552 run osmo-stp_10.42.42.5(pid=16984): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16984)] 08:52:15.664881 run osmo-stp_10.42.42.5(pid=16984): stdout: | (launched: 2022-12-09_08:52:14.318540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:15.795699 run osmo-stp_10.42.42.5(pid=16984): stderr: | [0;m[38;5;43m20221209085214491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085214491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085214491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085214492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085214492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085214492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085214492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:15.946158 run osmo-stp_10.42.42.5(pid=16984): stdout: | (launched: 2022-12-09_08:52:14.318540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:16.082191 run osmo-stp_10.42.42.5(pid=16984): stderr: | [0;m[38;5;43m20221209085214491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085214491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085214491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085214492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085214492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085214492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085214492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:16.247070 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16984): Process ended prematurely: osmo-stp_10.42.42.5(pid=16984) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16984)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:52:16.257787 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:52:16.289217 run osmo-hlr_10.42.42.2(pid=16981): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16981)] 08:52:16.343610 run osmo-hlr_10.42.42.2(pid=16981): stdout: | (launched: 2022-12-09_08:52:13.359904) 08:52:16.398927 run osmo-hlr_10.42.42.2(pid=16981): stderr: | [0;m[1;31m20221209085213538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085213538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085213538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085213538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085213538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085213538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085213553 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085213562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085213562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085213562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:16.474697 run osmo-msc_10.42.42.6(pid=16987): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16987)] 08:52:16.529217 run osmo-msc_10.42.42.6(pid=16987): stdout: | (launched: 2022-12-09_08:52:15.304489) 08:52:16.584472 run osmo-msc_10.42.42.6(pid=16987): stderr: | [0;m[38;5;43m20221209085215574 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085215574 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f731cfd0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085215575 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085215575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085215575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085215575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085215577 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085215577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085215577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085215577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:16.639761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16980): Terminating (SIGTERM) 08:52:16.685253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16983): Terminating (SIGTERM) 08:52:16.732351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16986): Terminating (SIGTERM) 08:52:16.780196 --- ParallelTerminationStrategy: PID 16980 died... 08:52:16.801109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16980): Terminated: ok {rc=0} 08:52:16.852278 --- ParallelTerminationStrategy: PID 16983 died... 08:52:16.873046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16983): Terminated: ok {rc=0} 08:52:16.923793 --- ParallelTerminationStrategy: PID 16986 died... 08:52:16.944388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16986): Terminated: ok {rc=0} 08:52:17.040450 bus /sierra_3: Setting Powered False 08:52:18.147893 bus /sierra_3: Setting Powered False 08:52:19.264648 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:52:20.520554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:20.526982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:52:20.561868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:52:20.589365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:52:20.643649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:52:20.677710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:52:20.704407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:52:21.262030 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:52:21.311009 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:21.322488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:52:21.393532 tst mo_mt_call.py: using LAC 20326 08:52:21.513778 tst mo_mt_call.py: using RAC 181 08:52:21.634328 tst mo_mt_call.py: using CellId 20326 08:52:21.755946 tst mo_mt_call.py: using BVCI 20327 08:52:21.877461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:21.889561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:21.904128 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:21.915418 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:21.926792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:21.937986 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:22.058223 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:22.177602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:22.658167 run create_hlr_db(pid=16992): Launched 08:52:22.784022 bus /sierra_2: Setting Powered False 08:52:23.844559 run create_hlr_db(pid=16992): Terminated: ok {rc=0} 08:52:24.293603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16994): Launched 08:52:24.623286 run osmo-hlr_10.42.42.2(pid=16995): Launched 08:52:24.750247 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:25.317992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16997): Launched 08:52:25.646877 run osmo-stp_10.42.42.5(pid=16998): Launched 08:52:25.775605 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:26.371555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17000): Launched 08:52:26.703032 run osmo-msc_10.42.42.6(pid=17001): Launched 08:52:26.888272 run osmo-stp_10.42.42.5(pid=16998): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16998)] 08:52:27.027554 run osmo-stp_10.42.42.5(pid=16998): stdout: | (launched: 2022-12-09_08:52:25.587098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:27.168064 run osmo-stp_10.42.42.5(pid=16998): stderr: | [0;m[38;5;43m20221209085225778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085225778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085225778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085225778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085225779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085225779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085225779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:27.306253 run osmo-stp_10.42.42.5(pid=16998): stdout: | (launched: 2022-12-09_08:52:25.587098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:27.438573 run osmo-stp_10.42.42.5(pid=16998): stderr: | [0;m[38;5;43m20221209085225778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085225778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085225778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085225778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085225779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085225779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085225779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:27.596401 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16998): Process ended prematurely: osmo-stp_10.42.42.5(pid=16998) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16998)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:52:27.606259 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:52:27.634887 run osmo-hlr_10.42.42.2(pid=16995): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16995)] 08:52:27.686032 run osmo-hlr_10.42.42.2(pid=16995): stdout: | (launched: 2022-12-09_08:52:24.562942) 08:52:27.738658 run osmo-hlr_10.42.42.2(pid=16995): stderr: | [0;m[1;31m20221209085224760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085224760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085224760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085224760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085224760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085224760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085224773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085224782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085224782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085224782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:27.812026 run osmo-msc_10.42.42.6(pid=17001): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17001)] 08:52:27.862845 run osmo-msc_10.42.42.6(pid=17001): stdout: | (launched: 2022-12-09_08:52:26.643201) 08:52:27.915443 run osmo-msc_10.42.42.6(pid=17001): stderr: | [0;m[38;5;43m20221209085226962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085226962 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ea3ed7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085226962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085226962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085226962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085226963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085226964 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085226965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085226965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085226965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:27.968465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16994): Terminating (SIGTERM) 08:52:28.011021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16997): Terminating (SIGTERM) 08:52:28.053780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17000): Terminating (SIGTERM) 08:52:28.096910 --- ParallelTerminationStrategy: PID 16994 died... 08:52:28.117229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16994): Terminated: ok {rc=0} 08:52:28.164400 --- ParallelTerminationStrategy: PID 16997 died... 08:52:28.184145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16997): Terminated: ok {rc=0} 08:52:28.230956 --- ParallelTerminationStrategy: PID 17000 died... 08:52:28.250684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17000): Terminated: ok {rc=0} 08:52:28.338664 bus /sierra_3: Setting Powered False 08:52:29.437273 bus /sierra_3: Setting Powered False 08:52:30.549923 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:52:31.702568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:31.716296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:52:31.793238 tst mo_mt_call_osmux.py: using LAC 20327 08:52:31.928106 tst mo_mt_call_osmux.py: using RAC 182 08:52:32.052174 tst mo_mt_call_osmux.py: using CellId 20327 08:52:32.187985 tst mo_mt_call_osmux.py: using BVCI 20328 08:52:32.310112 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:32.322224 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:32.334203 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:32.346837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:32.359547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:52:32.373036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:32.496583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:52:32.620430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:33.137148 run create_hlr_db(pid=17003): Launched 08:52:33.262744 bus /sierra_2: Setting Powered False 08:52:34.327788 run create_hlr_db(pid=17003): Terminated: ok {rc=0} 08:52:34.769389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17005): Launched 08:52:35.078210 run osmo-hlr_10.42.42.2(pid=17006): Launched 08:52:35.196920 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:35.742313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17008): Launched 08:52:36.071407 run osmo-stp_10.42.42.5(pid=17012): Launched 08:52:36.201395 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:36.800259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17014): Launched 08:52:37.130697 run osmo-msc_10.42.42.6(pid=17015): Launched 08:52:37.314371 run osmo-stp_10.42.42.5(pid=17012): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17012)] 08:52:37.453237 run osmo-stp_10.42.42.5(pid=17012): stdout: | (launched: 2022-12-09_08:52:36.011299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:37.592758 run osmo-stp_10.42.42.5(pid=17012): stderr: | [0;m[38;5;43m20221209085236202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085236202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085236202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085236202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085236203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085236203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085236203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:37.730376 run osmo-stp_10.42.42.5(pid=17012): stdout: | (launched: 2022-12-09_08:52:36.011299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:37.862048 run osmo-stp_10.42.42.5(pid=17012): stderr: | [0;m[38;5;43m20221209085236202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085236202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085236202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085236202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085236203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085236203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085236203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:38.019412 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17012): Process ended prematurely: osmo-stp_10.42.42.5(pid=17012) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17012)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:52:38.029168 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:52:38.057565 run osmo-hlr_10.42.42.2(pid=17006): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17006)] 08:52:38.108627 run osmo-hlr_10.42.42.2(pid=17006): stdout: | (launched: 2022-12-09_08:52:35.021819) 08:52:38.161372 run osmo-hlr_10.42.42.2(pid=17006): stderr: | [0;m[1;31m20221209085235197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085235197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085235198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085235198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085235198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085235198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085235210 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085235220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085235220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085235220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:38.234334 run osmo-msc_10.42.42.6(pid=17015): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17015)] 08:52:38.285208 run osmo-msc_10.42.42.6(pid=17015): stdout: | (launched: 2022-12-09_08:52:37.070378) 08:52:38.337609 run osmo-msc_10.42.42.6(pid=17015): stderr: | [0;m[38;5;43m20221209085237392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085237392 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07c0ab5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085237392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085237392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085237392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085237393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085237394 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085237395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085237395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085237395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:38.390660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17005): Terminating (SIGTERM) 08:52:38.432686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17008): Terminating (SIGTERM) 08:52:38.475053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17014): Terminating (SIGTERM) 08:52:38.517529 --- ParallelTerminationStrategy: PID 17005 died... 08:52:38.537545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17005): Terminated: ok {rc=0} 08:52:38.584529 --- ParallelTerminationStrategy: PID 17008 died... 08:52:38.604297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17008): Terminated: ok {rc=0} 08:52:38.651157 --- ParallelTerminationStrategy: PID 17014 died... 08:52:38.670746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17014): Terminated: ok {rc=0} 08:52:38.759724 bus /sierra_3: Setting Powered False 08:52:39.860426 bus /sierra_3: Setting Powered False 08:52:40.977529 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:52:42.240166 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:42.247590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:52:42.284121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:52:42.312383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:52:42.365516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:52:42.399643 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:52:42.426704 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:52:42.985858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:52:43.039099 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:43.051146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:52:43.123078 tst mo_mt_call.py: using LAC 20328 08:52:43.249380 tst mo_mt_call.py: using RAC 183 08:52:43.376537 tst mo_mt_call.py: using CellId 20328 08:52:43.502326 tst mo_mt_call.py: using BVCI 20329 08:52:43.623250 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:43.635111 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:43.646922 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:43.658915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:43.671222 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:43.683252 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:52:43.802066 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:52:43.923984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:44.437085 run create_hlr_db(pid=17020): Launched 08:52:44.562621 bus /sierra_2: Setting Powered False 08:52:45.625078 run create_hlr_db(pid=17020): Terminated: ok {rc=0} 08:52:46.101721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17022): Launched 08:52:46.433720 run osmo-hlr_10.42.42.2(pid=17023): Launched 08:52:46.580503 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:47.318556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17025): Launched 08:52:47.660270 run osmo-stp_10.42.42.5(pid=17026): Launched 08:52:47.788083 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:48.386753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17028): Launched 08:52:48.718011 run osmo-msc_10.42.42.6(pid=17029): Launched 08:52:48.903472 run osmo-stp_10.42.42.5(pid=17026): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17026)] 08:52:49.042053 run osmo-stp_10.42.42.5(pid=17026): stdout: | (launched: 2022-12-09_08:52:47.599781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:49.182282 run osmo-stp_10.42.42.5(pid=17026): stderr: | [0;m[38;5;43m20221209085247791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085247791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085247791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085247792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085247792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085247792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085247792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:49.320917 run osmo-stp_10.42.42.5(pid=17026): stdout: | (launched: 2022-12-09_08:52:47.599781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:49.453086 run osmo-stp_10.42.42.5(pid=17026): stderr: | [0;m[38;5;43m20221209085247791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085247791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085247791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085247792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085247792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085247792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085247792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:49.610513 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17026): Process ended prematurely: osmo-stp_10.42.42.5(pid=17026) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17026)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:52:49.620087 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:52:49.648235 run osmo-hlr_10.42.42.2(pid=17023): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17023)] 08:52:49.698943 run osmo-hlr_10.42.42.2(pid=17023): stdout: | (launched: 2022-12-09_08:52:46.373598) 08:52:49.751170 run osmo-hlr_10.42.42.2(pid=17023): stderr: | [0;m[1;31m20221209085246747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085246747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085246747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085246747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085246747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085246747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085246777 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085246799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085246799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085246799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:49.823852 run osmo-msc_10.42.42.6(pid=17029): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17029)] 08:52:49.874140 run osmo-msc_10.42.42.6(pid=17029): stdout: | (launched: 2022-12-09_08:52:48.657777) 08:52:49.926158 run osmo-msc_10.42.42.6(pid=17029): stderr: | [0;m[38;5;43m20221209085248982 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085248983 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2bd6e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085248983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085248983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085248983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085248983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085248985 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085248985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085248985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085248985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:52:49.978652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17022): Terminating (SIGTERM) 08:52:50.020892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17025): Terminating (SIGTERM) 08:52:50.063127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17028): Terminating (SIGTERM) 08:52:50.106036 --- ParallelTerminationStrategy: PID 17022 died... 08:52:50.126172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17022): Terminated: ok {rc=0} 08:52:50.173001 --- ParallelTerminationStrategy: PID 17025 died... 08:52:50.192631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17025): Terminated: ok {rc=0} 08:52:50.239111 --- ParallelTerminationStrategy: PID 17028 died... 08:52:50.258804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17028): Terminated: ok {rc=0} 08:52:50.347554 bus /sierra_3: Setting Powered False 08:52:51.447538 bus /sierra_3: Setting Powered False 08:52:52.564004 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:52:53.714856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:53.727624 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:52:53.801724 tst mo_mt_call_osmux.py: using LAC 20329 08:52:53.923126 tst mo_mt_call_osmux.py: using RAC 184 08:52:54.046916 tst mo_mt_call_osmux.py: using CellId 20329 08:52:54.169309 tst mo_mt_call_osmux.py: using BVCI 20330 08:52:54.280517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:54.292164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:54.303452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:54.314742 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:54.326095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:52:54.337328 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:52:54.460642 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:52:54.579639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:55.060816 run create_hlr_db(pid=17031): Launched 08:52:55.186565 bus /sierra_2: Setting Powered False 08:52:56.247570 run create_hlr_db(pid=17031): Terminated: ok {rc=0} 08:52:56.697188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17033): Launched 08:52:57.027311 run osmo-hlr_10.42.42.2(pid=17034): Launched 08:52:57.155663 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:57.723937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17036): Launched 08:52:58.053727 run osmo-stp_10.42.42.5(pid=17037): Launched 08:52:58.180262 run osmo-msc_10.42.42.6: Starting osmo-msc 08:52:58.778077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17039): Launched 08:52:59.109192 run osmo-msc_10.42.42.6(pid=17040): Launched 08:52:59.293405 run osmo-stp_10.42.42.5(pid=17037): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17037)] 08:52:59.433038 run osmo-stp_10.42.42.5(pid=17037): stdout: | (launched: 2022-12-09_08:52:57.993198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:59.572680 run osmo-stp_10.42.42.5(pid=17037): stderr: | [0;m[38;5;43m20221209085258188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085258188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085258188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085258189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085258189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085258189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085258189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:59.710526 run osmo-stp_10.42.42.5(pid=17037): stdout: | (launched: 2022-12-09_08:52:57.993198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:59.842547 run osmo-stp_10.42.42.5(pid=17037): stderr: | [0;m[38;5;43m20221209085258188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085258188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085258188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085258189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085258189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085258189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085258189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:00.000398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17037): Process ended prematurely: osmo-stp_10.42.42.5(pid=17037) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17037)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:53:00.010287 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:53:00.038840 run osmo-hlr_10.42.42.2(pid=17034): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17034)] 08:53:00.089680 run osmo-hlr_10.42.42.2(pid=17034): stdout: | (launched: 2022-12-09_08:52:56.967285) 08:53:00.142155 run osmo-hlr_10.42.42.2(pid=17034): stderr: | [0;m[1;31m20221209085257166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085257167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085257167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085257167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085257167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085257167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085257182 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085257190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085257190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085257191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:00.214839 run osmo-msc_10.42.42.6(pid=17040): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17040)] 08:53:00.265373 run osmo-msc_10.42.42.6(pid=17040): stdout: | (launched: 2022-12-09_08:52:59.047890) 08:53:00.317839 run osmo-msc_10.42.42.6(pid=17040): stderr: | [0;m[38;5;43m20221209085259374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085259374 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f520816cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085259374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085259374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085259374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085259374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085259376 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085259377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085259377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085259377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:00.370648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17033): Terminating (SIGTERM) 08:53:00.412538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17036): Terminating (SIGTERM) 08:53:00.454754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17039): Terminating (SIGTERM) 08:53:00.497178 --- ParallelTerminationStrategy: PID 17033 died... 08:53:00.517293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17033): Terminated: ok {rc=0} 08:53:00.564096 --- ParallelTerminationStrategy: PID 17036 died... 08:53:00.583677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17036): Terminated: ok {rc=0} 08:53:00.630613 --- ParallelTerminationStrategy: PID 17039 died... 08:53:00.650229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17039): Terminated: ok {rc=0} 08:53:00.738813 bus /sierra_3: Setting Powered False 08:53:01.853677 bus /sierra_3: Setting Powered False 08:53:03.010082 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:53:04.298211 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:04.306183 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:53:04.346770 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:53:04.377516 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:53:04.431904 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:53:04.469709 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:53:04.500371 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:53:05.052936 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:53:05.111488 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:05.124905 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:53:05.204494 tst mo_mt_call.py: using LAC 20330 08:53:05.329810 tst mo_mt_call.py: using RAC 185 08:53:05.450802 tst mo_mt_call.py: using CellId 20330 08:53:05.580424 tst mo_mt_call.py: using BVCI 20331 08:53:05.704471 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:05.717586 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:05.730365 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:05.745030 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:05.759125 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:05.772523 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:05.899517 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:06.027718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:06.551055 run create_hlr_db(pid=17317): Launched 08:53:06.718260 bus /sierra_2: Setting Powered False 08:53:07.783855 run create_hlr_db(pid=17317): Terminated: ok {rc=0} 08:53:08.251937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17319): Launched 08:53:08.604048 run osmo-hlr_10.42.42.2(pid=17320): Launched 08:53:08.850185 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:09.550772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17322): Launched 08:53:09.877825 run osmo-stp_10.42.42.5(pid=17323): Launched 08:53:10.116039 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:10.834082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17325): Launched 08:53:11.163133 run osmo-msc_10.42.42.6(pid=17326): Launched 08:53:11.519561 run osmo-stp_10.42.42.5(pid=17323): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17323)] 08:53:11.794734 run osmo-stp_10.42.42.5(pid=17323): stdout: | (launched: 2022-12-09_08:53:09.820132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:12.080930 run osmo-stp_10.42.42.5(pid=17323): stderr: | [0;m[38;5;43m20221209085310138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085310138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085310138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085310138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085310139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085310139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085310139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:12.222380 run osmo-stp_10.42.42.5(pid=17323): stdout: | (launched: 2022-12-09_08:53:09.820132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:12.349925 run osmo-stp_10.42.42.5(pid=17323): stderr: | [0;m[38;5;43m20221209085310138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085310138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085310138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085310138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085310139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085310139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085310139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:12.501236 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17323): Process ended prematurely: osmo-stp_10.42.42.5(pid=17323) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17323)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:53:12.511376 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 08:53:12.539513 run osmo-hlr_10.42.42.2(pid=17320): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17320)] 08:53:12.589841 run osmo-hlr_10.42.42.2(pid=17320): stdout: | (launched: 2022-12-09_08:53:08.540125) 08:53:12.641844 run osmo-hlr_10.42.42.2(pid=17320): stderr: | [0;m[1;31m20221209085308871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085308871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085308871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085308871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085308871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085308871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085308894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085308907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085308907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085308907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:12.713817 run osmo-msc_10.42.42.6(pid=17326): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17326)] 08:53:12.763592 run osmo-msc_10.42.42.6(pid=17326): stdout: | (launched: 2022-12-09_08:53:11.105289) 08:53:12.815371 run osmo-msc_10.42.42.6(pid=17326): stderr: | [0;m[38;5;43m20221209085311690 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085311690 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30f0683c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085311690 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085311690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085311691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085311691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085311701 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085311701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085311701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085311701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:12.867670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17319): Terminating (SIGTERM) 08:53:12.909815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17322): Terminating (SIGTERM) 08:53:12.954086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17325): Terminating (SIGTERM) 08:53:12.998970 --- ParallelTerminationStrategy: PID 17319 died... 08:53:13.019461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17319): Terminated: ok {rc=0} 08:53:13.066593 --- ParallelTerminationStrategy: PID 17322 died... 08:53:13.086113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17322): Terminated: ok {rc=0} 08:53:13.131430 --- ParallelTerminationStrategy: PID 17325 died... 08:53:13.151060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17325): Terminated: ok {rc=0} 08:53:13.238290 bus /sierra_3: Setting Powered False 08:53:14.339469 bus /sierra_3: Setting Powered False 08:53:15.455870 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:53:16.643301 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:16.659665 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:53:16.740407 tst mo_mt_call_osmux.py: using LAC 20331 08:53:16.889185 tst mo_mt_call_osmux.py: using RAC 186 08:53:17.054590 tst mo_mt_call_osmux.py: using CellId 20331 08:53:17.223501 tst mo_mt_call_osmux.py: using BVCI 20332 08:53:17.349694 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.362937 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.377050 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.391121 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.404239 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:53:17.418936 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:17.569412 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:53:17.725658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:18.257444 run create_hlr_db(pid=17328): Launched 08:53:18.420489 bus /sierra_2: Setting Powered False 08:53:19.483299 run create_hlr_db(pid=17328): Terminated: ok {rc=0} 08:53:19.935113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17330): Launched 08:53:20.268761 run osmo-hlr_10.42.42.2(pid=17331): Launched 08:53:20.522436 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:21.233823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17333): Launched 08:53:21.566380 run osmo-stp_10.42.42.5(pid=17334): Launched 08:53:21.817429 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:22.535528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17336): Launched 08:53:22.873342 run osmo-msc_10.42.42.6(pid=17337): Launched 08:53:23.239906 run osmo-stp_10.42.42.5(pid=17334): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17334)] 08:53:23.504781 run osmo-stp_10.42.42.5(pid=17334): stdout: | (launched: 2022-12-09_08:53:21.506998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:23.781623 run osmo-stp_10.42.42.5(pid=17334): stderr: | [0;m[38;5;43m20221209085321836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085321836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085321841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085321841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085321842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085321842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085321842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:23.911129 run osmo-stp_10.42.42.5(pid=17334): stdout: | (launched: 2022-12-09_08:53:21.506998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:24.034362 run osmo-stp_10.42.42.5(pid=17334): stderr: | [0;m[38;5;43m20221209085321836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085321836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085321841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085321841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085321842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085321842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085321842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:24.182293 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17334): Process ended prematurely: osmo-stp_10.42.42.5(pid=17334) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17334)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:53:24.191291 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 08:53:24.218018 run osmo-hlr_10.42.42.2(pid=17331): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17331)] 08:53:24.266176 run osmo-hlr_10.42.42.2(pid=17331): stdout: | (launched: 2022-12-09_08:53:20.210470) 08:53:24.316169 run osmo-hlr_10.42.42.2(pid=17331): stderr: | [0;m[1;31m20221209085320551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085320551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085320551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085320551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085320551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085320552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085320563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085320582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085320582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085320582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:24.385769 run osmo-msc_10.42.42.6(pid=17337): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17337)] 08:53:24.434112 run osmo-msc_10.42.42.6(pid=17337): stdout: | (launched: 2022-12-09_08:53:22.810004) 08:53:24.483874 run osmo-msc_10.42.42.6(pid=17337): stderr: | [0;m[38;5;43m20221209085323408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085323408 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f43067b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085323408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085323408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085323408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085323417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085323419 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085323419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085323419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085323419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:24.533934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17330): Terminating (SIGTERM) 08:53:24.573980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17333): Terminating (SIGTERM) 08:53:24.614415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17336): Terminating (SIGTERM) 08:53:24.654958 --- ParallelTerminationStrategy: PID 17330 died... 08:53:24.674206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17330): Terminated: ok {rc=0} 08:53:24.718557 --- ParallelTerminationStrategy: PID 17333 died... 08:53:24.737254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17333): Terminated: ok {rc=0} 08:53:24.781339 --- ParallelTerminationStrategy: PID 17336 died... 08:53:24.799935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17336): Terminated: ok {rc=0} 08:53:24.884237 bus /sierra_3: Setting Powered False 08:53:25.982480 bus /sierra_3: Setting Powered False 08:53:27.102028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:53:28.357475 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:28.363261 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:53:28.397408 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:53:28.424552 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:53:28.477225 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:53:28.511565 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:53:28.538482 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:53:29.089905 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:53:29.139514 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:29.150835 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:53:29.222877 tst mo_mt_call.py: using LAC 20332 08:53:29.344080 tst mo_mt_call.py: using RAC 187 08:53:29.470072 tst mo_mt_call.py: using CellId 20332 08:53:29.590729 tst mo_mt_call.py: using BVCI 20333 08:53:29.703921 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:29.715177 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:29.726278 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:29.737417 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:29.748439 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:29.759521 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:29.878939 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:30.001576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:30.516526 run create_hlr_db(pid=17343): Launched 08:53:30.643434 bus /sierra_2: Setting Powered False 08:53:31.703649 run create_hlr_db(pid=17343): Terminated: ok {rc=0} 08:53:32.217692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17345): Launched 08:53:32.541627 run osmo-hlr_10.42.42.2(pid=17346): Launched 08:53:32.660141 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:33.194687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17348): Launched 08:53:33.505141 run osmo-stp_10.42.42.5(pid=17349): Launched 08:53:33.622923 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:34.181665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17351): Launched 08:53:34.489586 run osmo-msc_10.42.42.6(pid=17352): Launched 08:53:34.661929 run osmo-stp_10.42.42.5(pid=17349): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17349)] 08:53:34.791079 run osmo-stp_10.42.42.5(pid=17349): stdout: | (launched: 2022-12-09_08:53:33.448300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:34.920635 run osmo-stp_10.42.42.5(pid=17349): stderr: | [0;m[38;5;43m20221209085333620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085333620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085333620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085333620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085333621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085333621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085333621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:35.048669 run osmo-stp_10.42.42.5(pid=17349): stdout: | (launched: 2022-12-09_08:53:33.448300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:35.172395 run osmo-stp_10.42.42.5(pid=17349): stderr: | [0;m[38;5;43m20221209085333620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085333620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085333620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085333620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085333621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085333621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085333621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:35.319609 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17349): Process ended prematurely: osmo-stp_10.42.42.5(pid=17349) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17349)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:53:35.328702 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:53:35.355238 run osmo-hlr_10.42.42.2(pid=17346): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17346)] 08:53:35.403343 run osmo-hlr_10.42.42.2(pid=17346): stdout: | (launched: 2022-12-09_08:53:32.485013) 08:53:35.453267 run osmo-hlr_10.42.42.2(pid=17346): stderr: | [0;m[1;31m20221209085332659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085332659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085332659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085332660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085332660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085332660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085332672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085332681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085332681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085332681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:35.523176 run osmo-msc_10.42.42.6(pid=17352): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17352)] 08:53:35.571923 run osmo-msc_10.42.42.6(pid=17352): stdout: | (launched: 2022-12-09_08:53:34.433081) 08:53:35.622101 run osmo-msc_10.42.42.6(pid=17352): stderr: | [0;m[38;5;43m20221209085334704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085334704 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd2e0bafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085334704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085334704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085334705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085334705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085334706 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085334707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085334707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085334707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:35.672441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17345): Terminating (SIGTERM) 08:53:35.712782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17348): Terminating (SIGTERM) 08:53:35.753199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17351): Terminating (SIGTERM) 08:53:35.793778 --- ParallelTerminationStrategy: PID 17345 died... 08:53:35.813191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17345): Terminated: ok {rc=0} 08:53:35.858038 --- ParallelTerminationStrategy: PID 17348 died... 08:53:35.876681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17348): Terminated: ok {rc=0} 08:53:35.921243 --- ParallelTerminationStrategy: PID 17351 died... 08:53:35.940190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17351): Terminated: ok {rc=0} 08:53:36.026660 bus /sierra_3: Setting Powered False 08:53:37.128539 bus /sierra_3: Setting Powered False 08:53:38.245221 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:53:39.390106 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:39.402037 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:53:39.474677 tst mo_mt_call_osmux.py: using LAC 20333 08:53:39.598618 tst mo_mt_call_osmux.py: using RAC 188 08:53:39.718866 tst mo_mt_call_osmux.py: using CellId 20333 08:53:39.838242 tst mo_mt_call_osmux.py: using BVCI 20334 08:53:39.951237 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:39.962816 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:39.974223 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:39.985398 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:39.996780 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:53:40.008164 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:40.126017 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:53:40.248149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:40.727742 run create_hlr_db(pid=17354): Launched 08:53:40.853999 bus /sierra_2: Setting Powered False 08:53:41.915260 run create_hlr_db(pid=17354): Terminated: ok {rc=0} 08:53:42.364547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17356): Launched 08:53:42.694223 run osmo-hlr_10.42.42.2(pid=17357): Launched 08:53:42.822040 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:43.395747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17359): Launched 08:53:43.725656 run osmo-stp_10.42.42.5(pid=17360): Launched 08:53:43.851848 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:44.447701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17362): Launched 08:53:44.778095 run osmo-msc_10.42.42.6(pid=17363): Launched 08:53:44.962624 run osmo-stp_10.42.42.5(pid=17360): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17360)] 08:53:45.102151 run osmo-stp_10.42.42.5(pid=17360): stdout: | (launched: 2022-12-09_08:53:43.665486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:45.242508 run osmo-stp_10.42.42.5(pid=17360): stderr: | [0;m[38;5;43m20221209085343857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085343857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085343857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085343858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085343858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085343858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085343858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:45.381089 run osmo-stp_10.42.42.5(pid=17360): stdout: | (launched: 2022-12-09_08:53:43.665486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:45.513042 run osmo-stp_10.42.42.5(pid=17360): stderr: | [0;m[38;5;43m20221209085343857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085343857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085343857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085343858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085343858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085343858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085343858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:45.670367 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17360): Process ended prematurely: osmo-stp_10.42.42.5(pid=17360) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17360)] [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:53:45.679902 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:53:45.708320 run osmo-hlr_10.42.42.2(pid=17357): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17357)] 08:53:45.759085 run osmo-hlr_10.42.42.2(pid=17357): stdout: | (launched: 2022-12-09_08:53:42.634243) 08:53:45.811435 run osmo-hlr_10.42.42.2(pid=17357): stderr: | [0;m[1;31m20221209085342832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085342832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085342832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085342832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085342832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085342832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085342847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085342856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085342856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085342856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:45.918953 run osmo-msc_10.42.42.6(pid=17363): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17363)] 08:53:45.970826 run osmo-msc_10.42.42.6(pid=17363): stdout: | (launched: 2022-12-09_08:53:44.717205) 08:53:46.030171 run osmo-msc_10.42.42.6(pid=17363): stderr: | [0;m[38;5;43m20221209085345036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085345036 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb5b7fdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085345036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085345036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085345036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085345036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085345038 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085345039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085345039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085345039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:46.092141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17356): Terminating (SIGTERM) 08:53:46.136587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17359): Terminating (SIGTERM) 08:53:46.181320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17362): Terminating (SIGTERM) 08:53:46.226412 --- ParallelTerminationStrategy: PID 17356 died... 08:53:46.246942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17356): Terminated: ok {rc=0} 08:53:46.298290 --- ParallelTerminationStrategy: PID 17359 died... 08:53:46.318931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17359): Terminated: ok {rc=0} 08:53:46.368533 --- ParallelTerminationStrategy: PID 17362 died... 08:53:46.389289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17362): Terminated: ok {rc=0} 08:53:46.481596 bus /sierra_3: Setting Powered False 08:53:47.587642 bus /sierra_3: Setting Powered False 08:53:48.704145 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 08:53:49.961661 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:49.966295 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:53:50.001699 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:53:50.029576 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 08:53:50.118401 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:53:50.154133 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:53:50.182472 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 08:53:50.772615 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 08:53:50.777924 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:50.789351 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:53:50.845844 tst emergency_mo_mt_call.py: using LAC 20334 08:53:50.975488 tst emergency_mo_mt_call.py: using RAC 189 08:53:51.101622 tst emergency_mo_mt_call.py: using CellId 20334 08:53:51.228266 tst emergency_mo_mt_call.py: using BVCI 20335 08:53:51.345828 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:51.357383 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:51.368559 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:51.380086 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:51.391514 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:53:51.403120 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:53:51.520618 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:53:51.638843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:52.108277 run create_hlr_db(pid=17368): Launched 08:53:52.234929 bus /sierra_2: Setting Powered False 08:53:53.295731 run create_hlr_db(pid=17368): Terminated: ok {rc=0} 08:53:53.739296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17370): Launched 08:53:54.064593 run osmo-hlr_10.42.42.2(pid=17371): Launched 08:53:54.189214 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:54.746917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17373): Launched 08:53:55.071952 run osmo-stp_10.42.42.5(pid=17374): Launched 08:53:55.205955 tst emergency_mo_mt_call.py: using MSISDN 7123 08:53:55.374748 run osmo-msc_10.42.42.6: Starting osmo-msc 08:53:55.956451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17376): Launched 08:53:56.280311 run osmo-msc_10.42.42.6(pid=17377): Launched 08:53:56.461590 run osmo-stp_10.42.42.5(pid=17374): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17374)] 08:53:56.598865 run osmo-stp_10.42.42.5(pid=17374): stdout: | (launched: 2022-12-09_08:53:55.012677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:56.735909 run osmo-stp_10.42.42.5(pid=17374): stderr: | [0;m[38;5;43m20221209085355205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085355205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085355205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085355206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085355206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085355207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085355207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:56.872138 run osmo-stp_10.42.42.5(pid=17374): stdout: | (launched: 2022-12-09_08:53:55.012677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:57.001245 run osmo-stp_10.42.42.5(pid=17374): stderr: | [0;m[38;5;43m20221209085355205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085355205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085355205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085355206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085355206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085355207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085355207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:57.155968 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17374): Process ended prematurely: osmo-stp_10.42.42.5(pid=17374) [trial-2357↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17374)] [trial-2357↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 08:53:57.164884 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 08:53:57.192868 run osmo-hlr_10.42.42.2(pid=17371): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17371)] 08:53:57.243762 run osmo-hlr_10.42.42.2(pid=17371): stdout: | (launched: 2022-12-09_08:53:54.004912) 08:53:57.295905 run osmo-hlr_10.42.42.2(pid=17371): stderr: | [0;m[1;31m20221209085354201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085354201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085354201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085354201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085354201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085354201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085354214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085354222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085354222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085354223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:57.369052 run osmo-msc_10.42.42.6(pid=17377): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17377)] 08:53:57.419669 run osmo-msc_10.42.42.6(pid=17377): stdout: | (launched: 2022-12-09_08:53:56.221068) 08:53:57.472004 run osmo-msc_10.42.42.6(pid=17377): stderr: | [0;m[38;5;43m20221209085356543 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085356543 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e10e68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085356543 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085356543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085356543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085356544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085356545 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085356546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085356546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085356546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:53:57.524671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17370): Terminating (SIGTERM) 08:53:57.567299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17373): Terminating (SIGTERM) 08:53:57.609729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17376): Terminating (SIGTERM) 08:53:57.652244 --- ParallelTerminationStrategy: PID 17370 died... 08:53:57.672193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17370): Terminated: ok {rc=0} 08:53:57.727576 --- ParallelTerminationStrategy: PID 17373 died... 08:53:57.746874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17373): Terminated: ok {rc=0} 08:53:57.792807 --- ParallelTerminationStrategy: PID 17376 died... 08:53:57.812412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17376): Terminated: ok {rc=0} 08:53:57.898985 bus /sierra_3: Setting Powered False 08:53:58.996871 bus /sierra_3: Setting Powered False 08:54:00.110991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 08:54:01.199461 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:54:01.213128 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:54:01.267880 tst emergency_preemptive_call.py: using LAC 20335 08:54:01.424851 tst emergency_preemptive_call.py: using RAC 190 08:54:01.552477 tst emergency_preemptive_call.py: using CellId 20335 08:54:01.674134 tst emergency_preemptive_call.py: using BVCI 20336 08:54:01.782085 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:54:01.794150 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:54:01.806088 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:54:01.817942 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:54:01.829797 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:54:01.841280 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:01.959561 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:02.107655 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:02.238152 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:02.361215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:02.851562 run create_hlr_db(pid=17379): Launched 08:54:02.971878 bus /sierra_2: Setting Powered False 08:54:04.034030 run create_hlr_db(pid=17379): Terminated: ok {rc=0} 08:54:04.474431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17381): Launched 08:54:04.789706 run osmo-hlr_10.42.42.2(pid=17382): Launched 08:54:04.909917 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:05.457884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17384): Launched 08:54:05.773370 run osmo-stp_10.42.42.5(pid=17385): Launched 08:54:05.904018 tst emergency_preemptive_call.py: using MSISDN 7124 08:54:06.067654 run osmo-msc_10.42.42.6: Starting osmo-msc 08:54:06.634847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17387): Launched 08:54:06.949913 run osmo-msc_10.42.42.6(pid=17388): Launched 08:54:07.126473 run osmo-stp_10.42.42.5(pid=17385): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17385)] 08:54:07.260336 run osmo-stp_10.42.42.5(pid=17385): stdout: | (launched: 2022-12-09_08:54:05.714878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:07.394786 run osmo-stp_10.42.42.5(pid=17385): stderr: | [0;m[38;5;43m20221209085405903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085405903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085405903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085405903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085405904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085405904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085405904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:07.527689 run osmo-stp_10.42.42.5(pid=17385): stdout: | (launched: 2022-12-09_08:54:05.714878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:07.653953 run osmo-stp_10.42.42.5(pid=17385): stderr: | [0;m[38;5;43m20221209085405903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085405903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085405903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085405903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085405904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085405904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085405904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:07.804887 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17385): Process ended prematurely: osmo-stp_10.42.42.5(pid=17385) [trial-2357↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17385)] [trial-2357↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 08:54:07.814258 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 08:54:07.842282 run osmo-hlr_10.42.42.2(pid=17382): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17382)] 08:54:07.893173 run osmo-hlr_10.42.42.2(pid=17382): stdout: | (launched: 2022-12-09_08:54:04.731844) 08:54:07.954006 run osmo-hlr_10.42.42.2(pid=17382): stderr: | [0;m[1;31m20221209085404925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085404925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085404925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085404925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085404925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085404925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085404938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085404949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085404949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085404949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:08.026045 run osmo-msc_10.42.42.6(pid=17388): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17388)] 08:54:08.075904 run osmo-msc_10.42.42.6(pid=17388): stdout: | (launched: 2022-12-09_08:54:06.891963) 08:54:08.128041 run osmo-msc_10.42.42.6(pid=17388): stderr: | [0;m[38;5;43m20221209085407208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085407208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf47174c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085407208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085407208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085407208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085407209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085407210 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085407211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085407211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085407211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:54:08.180376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17381): Terminating (SIGTERM) 08:54:08.222327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17384): Terminating (SIGTERM) 08:54:08.264081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17387): Terminating (SIGTERM) 08:54:08.306269 --- ParallelTerminationStrategy: PID 17381 died... 08:54:08.326125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17381): Terminated: ok {rc=0} 08:54:08.372556 --- ParallelTerminationStrategy: PID 17384 died... 08:54:08.392086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17384): Terminated: ok {rc=0} 08:54:08.438010 --- ParallelTerminationStrategy: PID 17387 died... 08:54:08.457514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17387): Terminated: ok {rc=0} 08:54:08.546428 bus /sierra_9: Setting Powered False 08:54:09.644210 bus /sierra_9: Setting Powered False 08:54:10.760354 bus /sierra_8: Setting Powered False 08:54:11.857633 bus /sierra_8: Setting Powered False 08:54:12.973822 bus /sierra_3: Setting Powered False 08:54:14.070628 bus /sierra_3: Setting Powered False 08:54:15.186611 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 08:54:16.510706 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:16.516163 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:54:16.555394 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 08:54:16.597605 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 08:54:16.693443 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:54:16.743513 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 08:54:16.791497 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 08:54:17.373828 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 08:54:17.428312 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:17.439976 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:54:17.490423 tst cs_paging_gprs_active.py: using LAC 20336 08:54:17.608588 tst cs_paging_gprs_active.py: using RAC 191 08:54:17.725227 tst cs_paging_gprs_active.py: using CellId 20336 08:54:17.841499 tst cs_paging_gprs_active.py: using BVCI 20337 08:54:17.952046 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:17.963024 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:17.973795 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:17.984384 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:17.994862 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:18.005368 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:18.015976 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:18.026476 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:18.037171 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:18.156091 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:18.274253 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:54:18.475852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:18.775733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17393): Launched 08:54:19.039964 run iperf3-srv_10.42.42.10(pid=17394): Launched 08:54:19.153636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:54:19.356062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:19.660728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17395): Launched 08:54:19.923575 run iperf3-srv_10.42.42.10(pid=17396): Launched 08:54:20.036641 tst cs_paging_gprs_active.py:38: start network... 08:54:20.239194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:20.708069 run create_hlr_db(pid=17397): Launched 08:54:20.831612 bus /sierra_2: Setting Powered False 08:54:21.892683 run create_hlr_db(pid=17397): Terminated: ok {rc=0} 08:54:22.336579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17399): Launched 08:54:22.661245 run osmo-hlr_10.42.42.2(pid=17400): Launched 08:54:22.784280 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:23.344798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17402): Launched 08:54:23.668723 run osmo-stp_10.42.42.5(pid=17403): Launched 08:54:23.791733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:24.350073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17405): Launched 08:54:24.473829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:24.747191 run patchelf(pid=17406): Launched 08:54:24.926685 run osmo-stp_10.42.42.5(pid=17403): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17403)] 08:54:25.063485 run osmo-stp_10.42.42.5(pid=17403): stdout: | (launched: 2022-12-09_08:54:23.609563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:25.202651 run osmo-stp_10.42.42.5(pid=17403): stderr: | [0;m[38;5;43m20221209085423797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085423798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085423798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085423798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085423799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085423799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085423799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:25.341498 run osmo-stp_10.42.42.5(pid=17403): stdout: | (launched: 2022-12-09_08:54:23.609563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:25.474394 run osmo-stp_10.42.42.5(pid=17403): stderr: | [0;m[38;5;43m20221209085423797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085423798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085423798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085423798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085423799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085423799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085423799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:25.632031 run patchelf(pid=17406): Terminating (SIGINT) 08:54:25.813741 run patchelf(pid=17406): Terminated: ok {rc=0} 08:54:25.944421 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17403): Process ended prematurely: osmo-stp_10.42.42.5(pid=17403) [trial-2357↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17403)] [trial-2357↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 08:54:25.954662 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:54:25.983428 run osmo-hlr_10.42.42.2(pid=17400): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17400)] 08:54:26.033140 run osmo-hlr_10.42.42.2(pid=17400): stdout: | (launched: 2022-12-09_08:54:22.602412) 08:54:26.084640 run osmo-hlr_10.42.42.2(pid=17400): stderr: | [0;m[1;31m20221209085422797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085422797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085422797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085422797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085422797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085422798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085422810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085422819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085422819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085422819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:26.137482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17393): Terminating (SIGTERM) 08:54:26.179255 run iperf3-srv_10.42.42.10(pid=17394): Terminating (SIGTERM) 08:54:26.220692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17395): Terminating (SIGTERM) 08:54:26.262465 run iperf3-srv_10.42.42.10(pid=17396): Terminating (SIGTERM) 08:54:26.303999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17399): Terminating (SIGTERM) 08:54:26.345780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17402): Terminating (SIGTERM) 08:54:26.387281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17405): Terminating (SIGTERM) 08:54:26.429223 --- ParallelTerminationStrategy: PID 17393 died... 08:54:26.448800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17393): Terminated: ok {rc=0} 08:54:26.495179 --- ParallelTerminationStrategy: PID 17394 died... 08:54:26.514566 run iperf3-srv_10.42.42.10(pid=17394): Terminated {rc=256} 08:54:26.560552 --- ParallelTerminationStrategy: PID 17395 died... 08:54:26.580117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17395): Terminated: ok {rc=0} 08:54:26.626226 --- ParallelTerminationStrategy: PID 17396 died... 08:54:26.645655 run iperf3-srv_10.42.42.10(pid=17396): Terminated {rc=256} 08:54:26.691472 --- ParallelTerminationStrategy: PID 17399 died... 08:54:26.711002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17399): Terminated: ok {rc=0} 08:54:26.757168 --- ParallelTerminationStrategy: PID 17402 died... 08:54:26.776611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17402): Terminated: ok {rc=0} 08:54:26.823446 --- ParallelTerminationStrategy: PID 17405 died... 08:54:26.843217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17405): Terminated: ok {rc=0} 08:54:26.931952 bus /gobi_0: Setting Powered False 08:54:28.031218 bus /gobi_0: Setting Powered False 08:54:29.146713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 08:54:30.294047 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.306172 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:54:30.360576 tst iperf3.py: using LAC 20337 08:54:30.488083 tst iperf3.py: using RAC 192 08:54:30.618579 tst iperf3.py: using CellId 20337 08:54:30.744326 tst iperf3.py: using BVCI 20338 08:54:30.862122 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.874193 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.885866 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.898991 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.911844 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.923799 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.937112 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.950530 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:30.963465 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:31.086587 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:54:31.300252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:31.617218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17407): Launched 08:54:31.908069 run iperf3-srv_10.42.42.10(pid=17408): Launched 08:54:32.040754 tst iperf3.py:8: start network... 08:54:32.251574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:32.725966 run create_hlr_db(pid=17409): Launched 08:54:32.850962 bus /gobi_6: Setting Powered False 08:54:33.911579 run create_hlr_db(pid=17409): Terminated: ok {rc=0} 08:54:34.357286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17411): Launched 08:54:34.684485 run osmo-hlr_10.42.42.2(pid=17412): Launched 08:54:34.809498 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:35.374925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17414): Launched 08:54:35.701673 run osmo-stp_10.42.42.5(pid=17415): Launched 08:54:35.826711 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:36.390291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17417): Launched 08:54:36.515638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:36.792160 run patchelf(pid=17418): Launched 08:54:36.973333 run osmo-stp_10.42.42.5(pid=17415): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17415)] 08:54:37.111610 run osmo-stp_10.42.42.5(pid=17415): stdout: | (launched: 2022-12-09_08:54:35.642214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:37.251811 run osmo-stp_10.42.42.5(pid=17415): stderr: | [0;m[38;5;43m20221209085435830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085435830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085435830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085435831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085435831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085435831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085435832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:37.391742 run osmo-stp_10.42.42.5(pid=17415): stdout: | (launched: 2022-12-09_08:54:35.642214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:37.526182 run osmo-stp_10.42.42.5(pid=17415): stderr: | [0;m[38;5;43m20221209085435830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085435830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085435830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085435831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085435831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085435831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085435832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:37.685144 run patchelf(pid=17418): Terminating (SIGINT) 08:54:37.868133 run patchelf(pid=17418): Terminated: ok {rc=0} 08:54:38.000114 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17415): Process ended prematurely: osmo-stp_10.42.42.5(pid=17415) [trial-2357↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17415)] [trial-2357↪gprs:trx-sysmocell5000↪iperf3.py:8] 08:54:38.010253 tst iperf3.py:8: Test FAILED (7.8 sec) 08:54:38.039138 run osmo-hlr_10.42.42.2(pid=17412): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17412)] 08:54:38.090134 run osmo-hlr_10.42.42.2(pid=17412): stdout: | (launched: 2022-12-09_08:54:34.625563) 08:54:38.142836 run osmo-hlr_10.42.42.2(pid=17412): stderr: | [0;m[1;31m20221209085434820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085434820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085434820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085434820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085434820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085434820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085434832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085434841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085434841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085434841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:38.196043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17407): Terminating (SIGTERM) 08:54:38.238668 run iperf3-srv_10.42.42.10(pid=17408): Terminating (SIGTERM) 08:54:38.281171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17411): Terminating (SIGTERM) 08:54:38.323771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17414): Terminating (SIGTERM) 08:54:38.366361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17417): Terminating (SIGTERM) 08:54:38.409403 --- ParallelTerminationStrategy: PID 17407 died... 08:54:38.429487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17407): Terminated: ok {rc=0} 08:54:38.476803 --- ParallelTerminationStrategy: PID 17408 died... 08:54:38.496776 run iperf3-srv_10.42.42.10(pid=17408): Terminated {rc=256} 08:54:38.543627 --- ParallelTerminationStrategy: PID 17411 died... 08:54:38.563432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17411): Terminated: ok {rc=0} 08:54:38.610300 --- ParallelTerminationStrategy: PID 17414 died... 08:54:38.630027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17414): Terminated: ok {rc=0} 08:54:38.676837 --- ParallelTerminationStrategy: PID 17417 died... 08:54:38.696846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17417): Terminated: ok {rc=0} 08:54:38.785483 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 08:54:39.934104 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:39.945974 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:54:39.996398 tst iperf3m4.py: using LAC 20338 08:54:40.117222 tst iperf3m4.py: using RAC 193 08:54:40.245884 tst iperf3m4.py: using CellId 20338 08:54:40.372692 tst iperf3m4.py: using BVCI 20339 08:54:40.491310 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.502813 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.515047 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.526580 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.538660 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.550530 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.562670 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.574714 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:40.587032 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:40.709891 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:40.831101 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:40.947879 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:54:41.064421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:54:41.269829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:41.575745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17419): Launched 08:54:41.841549 run iperf3-srv_10.42.42.10(pid=17420): Launched 08:54:41.955396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:54:42.159196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:42.464214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17421): Launched 08:54:42.728624 run iperf3-srv_10.42.42.10(pid=17422): Launched 08:54:42.842301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:54:43.045734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:43.351411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17423): Launched 08:54:43.616807 run iperf3-srv_10.42.42.10(pid=17424): Launched 08:54:43.731466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:54:43.935579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:44.241712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17425): Launched 08:54:44.505659 run iperf3-srv_10.42.42.10(pid=17426): Launched 08:54:44.619201 tst iperf3m4.py:8: start network... 08:54:44.822120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:45.294304 run create_hlr_db(pid=17427): Launched 08:54:45.418869 bus /gobi_6: Setting Powered False 08:54:46.478330 run create_hlr_db(pid=17427): Terminated: ok {rc=0} 08:54:46.921725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Launched 08:54:47.239377 run osmo-hlr_10.42.42.2(pid=17430): Launched 08:54:47.357873 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:47.901978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Launched 08:54:48.207248 run osmo-stp_10.42.42.5(pid=17433): Launched 08:54:48.323524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:48.850827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17435): Launched 08:54:48.967378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:49.225123 run patchelf(pid=17436): Launched 08:54:49.394604 run osmo-stp_10.42.42.5(pid=17433): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] 08:54:49.523702 run osmo-stp_10.42.42.5(pid=17433): stdout: | (launched: 2022-12-09_08:54:48.151217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:49.654493 run osmo-stp_10.42.42.5(pid=17433): stderr: | [0;m[38;5;43m20221209085448319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085448319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085448320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085448320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085448320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085448321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085448321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:49.786161 run osmo-stp_10.42.42.5(pid=17433): stdout: | (launched: 2022-12-09_08:54:48.151217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:49.911176 run osmo-stp_10.42.42.5(pid=17433): stderr: | [0;m[38;5;43m20221209085448319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085448319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085448320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085448320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085448320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085448321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085448321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:50.059340 run patchelf(pid=17436): Terminating (SIGINT) 08:54:50.230678 run patchelf(pid=17436): Terminated: ok {rc=0} 08:54:50.353942 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17433): Process ended prematurely: osmo-stp_10.42.42.5(pid=17433) [trial-2357↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] [trial-2357↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 08:54:50.363492 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:54:50.391076 run osmo-hlr_10.42.42.2(pid=17430): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17430)] 08:54:50.439172 run osmo-hlr_10.42.42.2(pid=17430): stdout: | (launched: 2022-12-09_08:54:47.182899) 08:54:50.488873 run osmo-hlr_10.42.42.2(pid=17430): stderr: | [0;m[1;31m20221209085447357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085447357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085447357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085447357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085447357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085447357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085447369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085447377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085447377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085447378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:50.539009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17419): Terminating (SIGTERM) 08:54:50.579181 run iperf3-srv_10.42.42.10(pid=17420): Terminating (SIGTERM) 08:54:50.619066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17421): Terminating (SIGTERM) 08:54:50.659333 run iperf3-srv_10.42.42.10(pid=17422): Terminating (SIGTERM) 08:54:50.699322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17423): Terminating (SIGTERM) 08:54:50.739175 run iperf3-srv_10.42.42.10(pid=17424): Terminating (SIGTERM) 08:54:50.779210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17425): Terminating (SIGTERM) 08:54:50.819297 run iperf3-srv_10.42.42.10(pid=17426): Terminating (SIGTERM) 08:54:50.859340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Terminating (SIGTERM) 08:54:50.899461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Terminating (SIGTERM) 08:54:50.939436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17435): Terminating (SIGTERM) 08:54:50.979729 --- ParallelTerminationStrategy: PID 17419 died... 08:54:50.998840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17419): Terminated: ok {rc=0} 08:54:51.043123 --- ParallelTerminationStrategy: PID 17420 died... 08:54:51.061863 run iperf3-srv_10.42.42.10(pid=17420): Terminated {rc=256} 08:54:51.105899 --- ParallelTerminationStrategy: PID 17421 died... 08:54:51.124708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17421): Terminated: ok {rc=0} 08:54:51.169132 --- ParallelTerminationStrategy: PID 17422 died... 08:54:51.187856 run iperf3-srv_10.42.42.10(pid=17422): Terminated {rc=256} 08:54:51.231815 --- ParallelTerminationStrategy: PID 17423 died... 08:54:51.250467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17423): Terminated: ok {rc=0} 08:54:51.294447 --- ParallelTerminationStrategy: PID 17424 died... 08:54:51.313090 run iperf3-srv_10.42.42.10(pid=17424): Terminated {rc=256} 08:54:51.357056 --- ParallelTerminationStrategy: PID 17425 died... 08:54:51.375716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17425): Terminated: ok {rc=0} 08:54:51.419597 --- ParallelTerminationStrategy: PID 17426 died... 08:54:51.438244 run iperf3-srv_10.42.42.10(pid=17426): Terminated {rc=256} 08:54:51.481945 --- ParallelTerminationStrategy: PID 17429 died... 08:54:51.500559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17429): Terminated: ok {rc=0} 08:54:51.544833 --- ParallelTerminationStrategy: PID 17432 died... 08:54:51.563942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17432): Terminated: ok {rc=0} 08:54:51.607861 --- ParallelTerminationStrategy: PID 17435 died... 08:54:51.626569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17435): Terminated: ok {rc=0} 08:54:51.711274 bus /gobi_4: Setting Powered False 08:54:52.806784 bus /gobi_4: Setting Powered False 08:54:53.921046 bus /gobi_1: Setting Powered False 08:54:55.020008 bus /gobi_1: Setting Powered False 08:54:56.135524 bus /gobi_0: Setting Powered False 08:54:57.233747 bus /gobi_0: Setting Powered False 08:54:58.349843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 08:54:59.452361 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:59.464566 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:54:59.517441 tst ping.py: using LAC 20339 08:54:59.637405 tst ping.py: using RAC 194 08:54:59.754794 tst ping.py: using CellId 20339 08:54:59.873315 tst ping.py: using BVCI 20340 08:54:59.981571 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:54:59.992521 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:00.003642 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:00.014799 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:00.025889 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:00.036593 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:00.047591 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:00.058640 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:55:00.174013 tst ping.py:19: start network... 08:55:00.374724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:00.846562 run create_hlr_db(pid=17437): Launched 08:55:01.026399 bus /gobi_6: Setting Powered False 08:55:02.103312 run create_hlr_db(pid=17437): Terminated: ok {rc=0} 08:55:02.573770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17442): Launched 08:55:02.873171 run osmo-hlr_10.42.42.2(pid=17443): Launched 08:55:02.986147 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:03.503025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17445): Launched 08:55:03.802599 run osmo-stp_10.42.42.5(pid=17446): Launched 08:55:03.916167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:04.432485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17448): Launched 08:55:04.546970 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:04.799595 run patchelf(pid=17449): Launched 08:55:04.965622 run osmo-stp_10.42.42.5(pid=17446): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17446)] 08:55:05.092595 run osmo-stp_10.42.42.5(pid=17446): stdout: | (launched: 2022-12-09_08:55:03.747102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:05.221401 run osmo-stp_10.42.42.5(pid=17446): stderr: | [0;m[38;5;43m20221209085503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085503916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085503916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085503916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:05.349741 run osmo-stp_10.42.42.5(pid=17446): stdout: | (launched: 2022-12-09_08:55:03.747102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:05.472816 run osmo-stp_10.42.42.5(pid=17446): stderr: | [0;m[38;5;43m20221209085503915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085503916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085503916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085503916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085503917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:05.618630 run patchelf(pid=17449): Terminating (SIGINT) 08:55:05.786301 run patchelf(pid=17449): Terminated: ok {rc=0} 08:55:05.908111 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17446): Process ended prematurely: osmo-stp_10.42.42.5(pid=17446) [trial-2357↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17446)] [trial-2357↪gprs:trx-sysmocell5000↪ping.py:22] 08:55:05.917156 tst ping.py:22: Test FAILED (6.5 sec) 08:55:05.944000 run osmo-hlr_10.42.42.2(pid=17443): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17443)] 08:55:05.991834 run osmo-hlr_10.42.42.2(pid=17443): stdout: | (launched: 2022-12-09_08:55:02.818119) 08:55:06.041770 run osmo-hlr_10.42.42.2(pid=17443): stderr: | [0;m[1;31m20221209085502992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085502992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085502992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085502992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085502992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085502992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085503007 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085503018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085503018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085503018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:06.092045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17442): Terminating (SIGTERM) 08:55:06.132604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17445): Terminating (SIGTERM) 08:55:06.173226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17448): Terminating (SIGTERM) 08:55:06.214052 --- ParallelTerminationStrategy: PID 17442 died... 08:55:06.232924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17442): Terminated: ok {rc=0} 08:55:06.277519 --- ParallelTerminationStrategy: PID 17445 died... 08:55:06.296639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17445): Terminated: ok {rc=0} 08:55:06.341285 --- ParallelTerminationStrategy: PID 17448 died... 08:55:06.360131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17448): Terminated: ok {rc=0} 08:55:06.446920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 08:55:07.536745 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:07.548497 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:55:07.599662 tst ping_idle_ping.py: using LAC 20340 08:55:07.718807 tst ping_idle_ping.py: using RAC 195 08:55:07.836541 tst ping_idle_ping.py: using CellId 20340 08:55:07.956528 tst ping_idle_ping.py: using BVCI 20341 08:55:08.065372 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:08.076360 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:08.087045 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:08.097974 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:08.108778 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:08.119680 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:08.130569 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:55:08.141294 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:55:08.259049 tst ping_idle_ping.py:24: start network... 08:55:08.459421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:08.929066 run create_hlr_db(pid=17450): Launched 08:55:09.052313 bus /gobi_6: Setting Powered False 08:55:10.113577 run create_hlr_db(pid=17450): Terminated: ok {rc=0} 08:55:10.540124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17452): Launched 08:55:10.842265 run osmo-hlr_10.42.42.2(pid=17453): Launched 08:55:10.956334 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:11.485475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17455): Launched 08:55:11.784694 run osmo-stp_10.42.42.5(pid=17456): Launched 08:55:11.899053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:12.425503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17458): Launched 08:55:12.539736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:12.792870 run patchelf(pid=17459): Launched 08:55:12.958916 run osmo-stp_10.42.42.5(pid=17456): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17456)] 08:55:13.085742 run osmo-stp_10.42.42.5(pid=17456): stdout: | (launched: 2022-12-09_08:55:11.729167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:13.214328 run osmo-stp_10.42.42.5(pid=17456): stderr: | [0;m[38;5;43m20221209085511896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085511896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085511896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085511896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085511897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085511897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085511897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:13.342940 run osmo-stp_10.42.42.5(pid=17456): stdout: | (launched: 2022-12-09_08:55:11.729167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:13.465587 run osmo-stp_10.42.42.5(pid=17456): stderr: | [0;m[38;5;43m20221209085511896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085511896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085511896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085511896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085511897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085511897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085511897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:13.610767 run patchelf(pid=17459): Terminating (SIGINT) 08:55:13.779189 run patchelf(pid=17459): Terminated: ok {rc=0} 08:55:13.900535 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17456): Process ended prematurely: osmo-stp_10.42.42.5(pid=17456) [trial-2357↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17456)] [trial-2357↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 08:55:13.909652 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:55:13.936767 run osmo-hlr_10.42.42.2(pid=17453): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17453)] 08:55:13.984461 run osmo-hlr_10.42.42.2(pid=17453): stdout: | (launched: 2022-12-09_08:55:10.786509) 08:55:14.033514 run osmo-hlr_10.42.42.2(pid=17453): stderr: | [0;m[1;31m20221209085510958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085510958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085510959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085510959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085510959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085510959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085510971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085510979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085510980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085510980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:14.083134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17452): Terminating (SIGTERM) 08:55:14.122900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17455): Terminating (SIGTERM) 08:55:14.162476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17458): Terminating (SIGTERM) 08:55:14.202325 --- ParallelTerminationStrategy: PID 17452 died... 08:55:14.221484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17452): Terminated: ok {rc=0} 08:55:14.265813 --- ParallelTerminationStrategy: PID 17455 died... 08:55:14.284439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17455): Terminated: ok {rc=0} 08:55:14.329107 --- ParallelTerminationStrategy: PID 17458 died... 08:55:14.347858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17458): Terminated: ok {rc=0} 08:55:14.432469 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 08:55:15.751227 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:55:15.756842 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:55:15.792662 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:55:15.835557 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:55:15.931404 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:55:15.980499 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:55:16.023046 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:55:16.614216 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:55:16.672160 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:16.684896 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:55:16.739149 tst cs_paging_gprs_active.py: using LAC 20341 08:55:16.899078 tst cs_paging_gprs_active.py: using RAC 196 08:55:17.021892 tst cs_paging_gprs_active.py: using CellId 20341 08:55:17.185347 tst cs_paging_gprs_active.py: using BVCI 20342 08:55:17.300289 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.311931 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.324731 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.336532 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.348080 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.360138 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.372014 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.383587 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:17.395345 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:55:17.513574 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:55:17.636545 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:55:17.858899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:18.188262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17464): Launched 08:55:18.472101 run iperf3-srv_10.42.42.10(pid=17465): Launched 08:55:18.594699 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:55:18.815947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:19.144254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17466): Launched 08:55:19.428005 run iperf3-srv_10.42.42.10(pid=17467): Launched 08:55:19.549902 tst cs_paging_gprs_active.py:38: start network... 08:55:19.770733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:20.278919 run create_hlr_db(pid=17468): Launched 08:55:20.403389 bus /gobi_6: Setting Powered False 08:55:21.467683 run create_hlr_db(pid=17468): Terminated: ok {rc=0} 08:55:21.922642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17470): Launched 08:55:22.251221 run osmo-hlr_10.42.42.2(pid=17471): Launched 08:55:22.375851 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:22.941367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17473): Launched 08:55:23.267588 run osmo-stp_10.42.42.5(pid=17474): Launched 08:55:23.392602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:23.958405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17476): Launched 08:55:24.083873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:24.361346 run patchelf(pid=17477): Launched 08:55:24.543777 run osmo-stp_10.42.42.5(pid=17474): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17474)] 08:55:24.681707 run osmo-stp_10.42.42.5(pid=17474): stdout: | (launched: 2022-12-09_08:55:23.208351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:24.820901 run osmo-stp_10.42.42.5(pid=17474): stderr: | [0;m[38;5;43m20221209085523396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085523397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085523397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085523397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:24.959923 run osmo-stp_10.42.42.5(pid=17474): stdout: | (launched: 2022-12-09_08:55:23.208351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:25.093546 run osmo-stp_10.42.42.5(pid=17474): stderr: | [0;m[38;5;43m20221209085523396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085523397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085523397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085523397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085523398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:25.252685 run patchelf(pid=17477): Terminating (SIGINT) 08:55:25.434846 run patchelf(pid=17477): Terminated: ok {rc=0} 08:55:25.566356 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17474): Process ended prematurely: osmo-stp_10.42.42.5(pid=17474) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17474)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:55:25.576377 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 08:55:25.605075 run osmo-hlr_10.42.42.2(pid=17471): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17471)] 08:55:25.655068 run osmo-hlr_10.42.42.2(pid=17471): stdout: | (launched: 2022-12-09_08:55:22.191684) 08:55:25.706708 run osmo-hlr_10.42.42.2(pid=17471): stderr: | [0;m[1;31m20221209085522386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085522386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085522386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085522386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085522386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085522386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085522398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085522406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085522406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085522406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:25.758914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17464): Terminating (SIGTERM) 08:55:25.800936 run iperf3-srv_10.42.42.10(pid=17465): Terminating (SIGTERM) 08:55:25.842787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17466): Terminating (SIGTERM) 08:55:25.884909 run iperf3-srv_10.42.42.10(pid=17467): Terminating (SIGTERM) 08:55:25.926842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17470): Terminating (SIGTERM) 08:55:25.968610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17473): Terminating (SIGTERM) 08:55:26.010499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17476): Terminating (SIGTERM) 08:55:26.052557 --- ParallelTerminationStrategy: PID 17464 died... 08:55:26.072530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17464): Terminated: ok {rc=0} 08:55:26.119394 --- ParallelTerminationStrategy: PID 17465 died... 08:55:26.138749 run iperf3-srv_10.42.42.10(pid=17465): Terminated {rc=256} 08:55:26.185066 --- ParallelTerminationStrategy: PID 17466 died... 08:55:26.204435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17466): Terminated: ok {rc=0} 08:55:26.250614 --- ParallelTerminationStrategy: PID 17467 died... 08:55:26.269919 run iperf3-srv_10.42.42.10(pid=17467): Terminated {rc=256} 08:55:26.315840 --- ParallelTerminationStrategy: PID 17470 died... 08:55:26.335074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17470): Terminated: ok {rc=0} 08:55:26.381369 --- ParallelTerminationStrategy: PID 17473 died... 08:55:26.400620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17473): Terminated: ok {rc=0} 08:55:26.446658 --- ParallelTerminationStrategy: PID 17476 died... 08:55:26.466134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17476): Terminated: ok {rc=0} 08:55:26.554060 bus /gobi_0: Setting Powered False 08:55:27.652286 bus /gobi_0: Setting Powered False 08:55:28.768035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:55:29.917545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:29.929651 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:55:29.992517 tst iperf3.py: using LAC 20342 08:55:30.133625 tst iperf3.py: using RAC 197 08:55:30.255696 tst iperf3.py: using CellId 20342 08:55:30.375122 tst iperf3.py: using BVCI 20343 08:55:30.485820 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.496929 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.507836 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.518717 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.529595 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.540384 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.551353 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.562144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:30.573139 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:55:30.691799 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:55:30.927414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:31.243251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17479): Launched 08:55:31.528292 run iperf3-srv_10.42.42.10(pid=17480): Launched 08:55:31.674791 tst iperf3.py:8: start network... 08:55:31.887020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:32.373115 run create_hlr_db(pid=17481): Launched 08:55:32.497488 bus /gobi_6: Setting Powered False 08:55:33.558195 run create_hlr_db(pid=17481): Terminated: ok {rc=0} 08:55:33.982658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17483): Launched 08:55:34.288338 run osmo-hlr_10.42.42.2(pid=17484): Launched 08:55:34.404127 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:34.946601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17486): Launched 08:55:35.250854 run osmo-stp_10.42.42.5(pid=17487): Launched 08:55:35.366369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:35.904551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17489): Launched 08:55:36.020893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:36.279742 run patchelf(pid=17490): Launched 08:55:36.448716 run osmo-stp_10.42.42.5(pid=17487): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17487)] 08:55:36.577666 run osmo-stp_10.42.42.5(pid=17487): stdout: | (launched: 2022-12-09_08:55:35.194842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:36.708324 run osmo-stp_10.42.42.5(pid=17487): stderr: | [0;m[38;5;43m20221209085535364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085535364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085535365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085535365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:36.838823 run osmo-stp_10.42.42.5(pid=17487): stdout: | (launched: 2022-12-09_08:55:35.194842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:36.963849 run osmo-stp_10.42.42.5(pid=17487): stderr: | [0;m[38;5;43m20221209085535364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085535364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085535365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085535365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085535366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:37.111644 run patchelf(pid=17490): Terminating (SIGINT) 08:55:37.282113 run patchelf(pid=17490): Terminated: ok {rc=0} 08:55:37.404936 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17487): Process ended prematurely: osmo-stp_10.42.42.5(pid=17487) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17487)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 08:55:37.414502 tst iperf3.py:8: Test FAILED (7.5 sec) 08:55:37.441341 run osmo-hlr_10.42.42.2(pid=17484): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17484)] 08:55:37.488443 run osmo-hlr_10.42.42.2(pid=17484): stdout: | (launched: 2022-12-09_08:55:34.232471) 08:55:37.537700 run osmo-hlr_10.42.42.2(pid=17484): stderr: | [0;m[1;31m20221209085534407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085534407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085534407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085534407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085534407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085534407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085534420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085534429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085534429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085534429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:37.586798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17479): Terminating (SIGTERM) 08:55:37.626544 run iperf3-srv_10.42.42.10(pid=17480): Terminating (SIGTERM) 08:55:37.666325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17483): Terminating (SIGTERM) 08:55:37.706091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17486): Terminating (SIGTERM) 08:55:37.745734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17489): Terminating (SIGTERM) 08:55:37.787131 --- ParallelTerminationStrategy: PID 17479 died... 08:55:37.806290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17479): Terminated: ok {rc=0} 08:55:37.849975 --- ParallelTerminationStrategy: PID 17480 died... 08:55:37.868351 run iperf3-srv_10.42.42.10(pid=17480): Terminated {rc=256} 08:55:37.911861 --- ParallelTerminationStrategy: PID 17483 died... 08:55:37.930366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17483): Terminated: ok {rc=0} 08:55:37.973970 --- ParallelTerminationStrategy: PID 17486 died... 08:55:37.992534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17486): Terminated: ok {rc=0} 08:55:38.036790 --- ParallelTerminationStrategy: PID 17489 died... 08:55:38.055367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17489): Terminated: ok {rc=0} 08:55:38.139560 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:55:39.286966 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.298757 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:55:39.350509 tst iperf3m4.py: using LAC 20343 08:55:39.472316 tst iperf3m4.py: using RAC 198 08:55:39.592336 tst iperf3m4.py: using CellId 20343 08:55:39.720641 tst iperf3m4.py: using BVCI 20344 08:55:39.839699 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.851440 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.862958 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.874733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.886248 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.897845 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.909631 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.921466 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:39.933280 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:55:40.052481 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:55:40.174057 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:55:40.293594 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:55:40.412558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:55:40.620016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:40.927925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17491): Launched 08:55:41.193768 run iperf3-srv_10.42.42.10(pid=17492): Launched 08:55:41.307482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:55:41.511526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:41.817749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17493): Launched 08:55:42.083691 run iperf3-srv_10.42.42.10(pid=17494): Launched 08:55:42.198564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:55:42.403010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:42.710048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17495): Launched 08:55:42.976214 run iperf3-srv_10.42.42.10(pid=17496): Launched 08:55:43.090324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:55:43.295097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:43.601519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17497): Launched 08:55:43.867559 run iperf3-srv_10.42.42.10(pid=17498): Launched 08:55:43.981634 tst iperf3m4.py:8: start network... 08:55:44.186685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:44.660783 run create_hlr_db(pid=17499): Launched 08:55:44.785458 bus /gobi_6: Setting Powered False 08:55:45.846618 run create_hlr_db(pid=17499): Terminated: ok {rc=0} 08:55:46.325830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17501): Launched 08:55:46.675499 run osmo-hlr_10.42.42.2(pid=17502): Launched 08:55:46.930400 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:47.573873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17504): Launched 08:55:47.901466 run osmo-stp_10.42.42.5(pid=17505): Launched 08:55:48.027134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:48.591348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17507): Launched 08:55:48.715786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:48.991536 run patchelf(pid=17508): Launched 08:55:49.174392 run osmo-stp_10.42.42.5(pid=17505): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17505)] 08:55:49.312812 run osmo-stp_10.42.42.5(pid=17505): stdout: | (launched: 2022-12-09_08:55:47.841687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:49.453135 run osmo-stp_10.42.42.5(pid=17505): stderr: | [0;m[38;5;43m20221209085548031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085548031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085548031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085548031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085548032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085548032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085548032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:49.593269 run osmo-stp_10.42.42.5(pid=17505): stdout: | (launched: 2022-12-09_08:55:47.841687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:49.727682 run osmo-stp_10.42.42.5(pid=17505): stderr: | [0;m[38;5;43m20221209085548031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085548031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085548031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085548031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085548032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085548032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085548032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:49.886926 run patchelf(pid=17508): Terminating (SIGINT) 08:55:50.070667 run patchelf(pid=17508): Terminated: ok {rc=0} 08:55:50.203732 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17505): Process ended prematurely: osmo-stp_10.42.42.5(pid=17505) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17505)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 08:55:50.213910 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:55:50.243380 run osmo-hlr_10.42.42.2(pid=17502): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17502)] 08:55:50.293715 run osmo-hlr_10.42.42.2(pid=17502): stdout: | (launched: 2022-12-09_08:55:46.612260) 08:55:50.346121 run osmo-hlr_10.42.42.2(pid=17502): stderr: | [0;m[1;31m20221209085546919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085546919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085546919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085546919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085546919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085546919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085546940 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085546948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085546948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085546953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:50.398612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17491): Terminating (SIGTERM) 08:55:50.440656 run iperf3-srv_10.42.42.10(pid=17492): Terminating (SIGTERM) 08:55:50.482647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17493): Terminating (SIGTERM) 08:55:50.524798 run iperf3-srv_10.42.42.10(pid=17494): Terminating (SIGTERM) 08:55:50.567041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17495): Terminating (SIGTERM) 08:55:50.609043 run iperf3-srv_10.42.42.10(pid=17496): Terminating (SIGTERM) 08:55:50.650842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17497): Terminating (SIGTERM) 08:55:50.692827 run iperf3-srv_10.42.42.10(pid=17498): Terminating (SIGTERM) 08:55:50.734853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17501): Terminating (SIGTERM) 08:55:50.776903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17504): Terminating (SIGTERM) 08:55:50.818874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17507): Terminating (SIGTERM) 08:55:50.861267 --- ParallelTerminationStrategy: PID 17491 died... 08:55:50.881216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17491): Terminated: ok {rc=0} 08:55:50.927721 --- ParallelTerminationStrategy: PID 17492 died... 08:55:50.947090 run iperf3-srv_10.42.42.10(pid=17492): Terminated {rc=256} 08:55:50.993377 --- ParallelTerminationStrategy: PID 17493 died... 08:55:51.012775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17493): Terminated: ok {rc=0} 08:55:51.059623 --- ParallelTerminationStrategy: PID 17494 died... 08:55:51.079195 run iperf3-srv_10.42.42.10(pid=17494): Terminated {rc=256} 08:55:51.125657 --- ParallelTerminationStrategy: PID 17495 died... 08:55:51.145088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17495): Terminated: ok {rc=0} 08:55:51.191791 --- ParallelTerminationStrategy: PID 17496 died... 08:55:51.211357 run iperf3-srv_10.42.42.10(pid=17496): Terminated {rc=256} 08:55:51.257620 --- ParallelTerminationStrategy: PID 17497 died... 08:55:51.277110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17497): Terminated: ok {rc=0} 08:55:51.323479 --- ParallelTerminationStrategy: PID 17498 died... 08:55:51.342999 run iperf3-srv_10.42.42.10(pid=17498): Terminated {rc=256} 08:55:51.389445 --- ParallelTerminationStrategy: PID 17501 died... 08:55:51.408893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17501): Terminated: ok {rc=0} 08:55:51.455277 --- ParallelTerminationStrategy: PID 17504 died... 08:55:51.474729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17504): Terminated: ok {rc=0} 08:55:51.521183 --- ParallelTerminationStrategy: PID 17507 died... 08:55:51.540805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17507): Terminated: ok {rc=0} 08:55:51.629798 bus /gobi_4: Setting Powered False 08:55:52.729644 bus /gobi_4: Setting Powered False 08:55:53.847274 bus /gobi_1: Setting Powered False 08:55:54.946873 bus /gobi_1: Setting Powered False 08:55:56.060380 bus /gobi_0: Setting Powered False 08:55:57.158924 bus /gobi_0: Setting Powered False 08:55:58.275493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 08:55:59.378915 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.391195 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:55:59.445617 tst ping.py: using LAC 20344 08:55:59.566621 tst ping.py: using RAC 199 08:55:59.686625 tst ping.py: using CellId 20344 08:55:59.806588 tst ping.py: using BVCI 20345 08:55:59.917289 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.928504 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.939703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.950757 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.961699 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.972548 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.983744 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:55:59.994771 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:00.110429 tst ping.py:19: start network... 08:56:00.311100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:00.775518 run create_hlr_db(pid=17509): Launched 08:56:00.922948 bus /gobi_6: Setting Powered False 08:56:02.002648 run create_hlr_db(pid=17509): Terminated: ok {rc=0} 08:56:02.520870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17511): Launched 08:56:02.822004 run osmo-hlr_10.42.42.2(pid=17512): Launched 08:56:02.938224 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:03.458468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17514): Launched 08:56:03.758534 run osmo-stp_10.42.42.5(pid=17515): Launched 08:56:03.872052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:04.392145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17517): Launched 08:56:04.507162 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:04.761531 run patchelf(pid=17518): Launched 08:56:04.930055 run osmo-stp_10.42.42.5(pid=17515): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17515)] 08:56:05.056655 run osmo-stp_10.42.42.5(pid=17515): stdout: | (launched: 2022-12-09_08:56:03.703344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:05.185097 run osmo-stp_10.42.42.5(pid=17515): stderr: | [0;m[38;5;43m20221209085603871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085603871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085603871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085603872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085603872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085603872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085603872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:05.313438 run osmo-stp_10.42.42.5(pid=17515): stdout: | (launched: 2022-12-09_08:56:03.703344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:05.436319 run osmo-stp_10.42.42.5(pid=17515): stderr: | [0;m[38;5;43m20221209085603871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085603871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085603871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085603872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085603872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085603872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085603872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:05.581880 run patchelf(pid=17518): Terminating (SIGINT) 08:56:05.749776 run patchelf(pid=17518): Terminated: ok {rc=0} 08:56:05.870772 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17515): Process ended prematurely: osmo-stp_10.42.42.5(pid=17515) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17515)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 08:56:05.879521 tst ping.py:22: Test FAILED (6.5 sec) 08:56:05.906245 run osmo-hlr_10.42.42.2(pid=17512): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17512)] 08:56:05.953743 run osmo-hlr_10.42.42.2(pid=17512): stdout: | (launched: 2022-12-09_08:56:02.766370) 08:56:06.002965 run osmo-hlr_10.42.42.2(pid=17512): stderr: | [0;m[1;31m20221209085602939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085602939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085602939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085602939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085602939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085602939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085602954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085602964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085602964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085602964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:06.052659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17511): Terminating (SIGTERM) 08:56:06.092667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17514): Terminating (SIGTERM) 08:56:06.132481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17517): Terminating (SIGTERM) 08:56:06.172604 --- ParallelTerminationStrategy: PID 17511 died... 08:56:06.191790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17511): Terminated: ok {rc=0} 08:56:06.235902 --- ParallelTerminationStrategy: PID 17514 died... 08:56:06.254573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17514): Terminated: ok {rc=0} 08:56:06.298519 --- ParallelTerminationStrategy: PID 17517 died... 08:56:06.317235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17517): Terminated: ok {rc=0} 08:56:06.403948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:56:07.492461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:07.504436 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:56:07.557582 tst ping_idle_ping.py: using LAC 20345 08:56:07.680458 tst ping_idle_ping.py: using RAC 200 08:56:07.798859 tst ping_idle_ping.py: using CellId 20345 08:56:07.917586 tst ping_idle_ping.py: using BVCI 20346 08:56:08.028831 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:08.040135 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:08.051222 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:08.062245 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:08.073163 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:08.084005 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:08.095113 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:56:08.106198 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:56:08.228004 tst ping_idle_ping.py:24: start network... 08:56:08.446855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:08.951835 run create_hlr_db(pid=17519): Launched 08:56:09.076041 bus /gobi_6: Setting Powered False 08:56:10.140566 run create_hlr_db(pid=17519): Terminated: ok {rc=0} 08:56:10.575511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17521): Launched 08:56:10.878841 run osmo-hlr_10.42.42.2(pid=17522): Launched 08:56:10.993368 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:11.527768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17524): Launched 08:56:11.829332 run osmo-stp_10.42.42.5(pid=17525): Launched 08:56:11.944644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:12.468147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17527): Launched 08:56:12.583966 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:12.839383 run patchelf(pid=17528): Launched 08:56:13.007436 run osmo-stp_10.42.42.5(pid=17525): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17525)] 08:56:13.135157 run osmo-stp_10.42.42.5(pid=17525): stdout: | (launched: 2022-12-09_08:56:11.773638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:13.264579 run osmo-stp_10.42.42.5(pid=17525): stderr: | [0;m[38;5;43m20221209085611941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085611941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085611941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085611942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085611942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085611942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085611942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:13.394248 run osmo-stp_10.42.42.5(pid=17525): stdout: | (launched: 2022-12-09_08:56:11.773638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:13.517952 run osmo-stp_10.42.42.5(pid=17525): stderr: | [0;m[38;5;43m20221209085611941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085611941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085611941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085611942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085611942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085611942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085611942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:13.666455 run patchelf(pid=17528): Terminating (SIGINT) 08:56:13.835485 run patchelf(pid=17528): Terminated: ok {rc=0} 08:56:13.956727 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17525): Process ended prematurely: osmo-stp_10.42.42.5(pid=17525) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17525)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 08:56:13.965710 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:56:13.992433 run osmo-hlr_10.42.42.2(pid=17522): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17522)] 08:56:14.039940 run osmo-hlr_10.42.42.2(pid=17522): stdout: | (launched: 2022-12-09_08:56:10.822696) 08:56:14.089221 run osmo-hlr_10.42.42.2(pid=17522): stderr: | [0;m[1;31m20221209085610999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085610999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085610999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085610999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085610999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085610999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085611011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085611020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085611020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085611021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:14.138715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17521): Terminating (SIGTERM) 08:56:14.178456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17524): Terminating (SIGTERM) 08:56:14.218067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17527): Terminating (SIGTERM) 08:56:14.257976 --- ParallelTerminationStrategy: PID 17521 died... 08:56:14.277146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17521): Terminated: ok {rc=0} 08:56:14.321043 --- ParallelTerminationStrategy: PID 17524 died... 08:56:14.339559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17524): Terminated: ok {rc=0} 08:56:14.384026 --- ParallelTerminationStrategy: PID 17527 died... 08:56:14.402759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17527): Terminated: ok {rc=0} 08:56:14.486979 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:56:15.807023 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:15.813947 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:56:15.858304 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:56:15.903959 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:56:16.010139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:56:16.059217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:56:16.102367 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:56:16.694544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:56:16.750199 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:16.762552 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:56:16.838230 tst cs_paging_gprs_active.py: using LAC 20346 08:56:16.991034 tst cs_paging_gprs_active.py: using RAC 201 08:56:17.122769 tst cs_paging_gprs_active.py: using CellId 20346 08:56:17.255484 tst cs_paging_gprs_active.py: using BVCI 20347 08:56:17.379334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.391055 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.402615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.415118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.427453 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.439675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.451945 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.463968 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:17.476335 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:56:17.598049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:56:17.721056 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:56:17.943332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:18.273159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17533): Launched 08:56:18.558629 run iperf3-srv_10.42.42.10(pid=17534): Launched 08:56:18.683207 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:56:18.904924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:19.234693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17535): Launched 08:56:19.521248 run iperf3-srv_10.42.42.10(pid=17536): Launched 08:56:19.644221 tst cs_paging_gprs_active.py:38: start network... 08:56:19.866588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:20.378635 run create_hlr_db(pid=17537): Launched 08:56:20.504934 bus /gobi_6: Setting Powered False 08:56:21.566407 run create_hlr_db(pid=17537): Terminated: ok {rc=0} 08:56:22.003415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17539): Launched 08:56:22.311626 run osmo-hlr_10.42.42.2(pid=17540): Launched 08:56:22.428937 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:22.958245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17542): Launched 08:56:23.264891 run osmo-stp_10.42.42.5(pid=17543): Launched 08:56:23.382023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:23.911065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17545): Launched 08:56:24.030229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:24.289491 run patchelf(pid=17546): Launched 08:56:24.459648 run osmo-stp_10.42.42.5(pid=17543): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17543)] 08:56:24.589961 run osmo-stp_10.42.42.5(pid=17543): stdout: | (launched: 2022-12-09_08:56:23.208809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:24.720902 run osmo-stp_10.42.42.5(pid=17543): stderr: | [0;m[38;5;43m20221209085623379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085623379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085623379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085623379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085623380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085623380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085623380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:24.851929 run osmo-stp_10.42.42.5(pid=17543): stdout: | (launched: 2022-12-09_08:56:23.208809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:24.977147 run osmo-stp_10.42.42.5(pid=17543): stderr: | [0;m[38;5;43m20221209085623379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085623379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085623379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085623379 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085623380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085623380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085623380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:25.125708 run patchelf(pid=17546): Terminating (SIGINT) 08:56:25.297287 run patchelf(pid=17546): Terminated: ok {rc=0} 08:56:25.420826 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17543): Process ended prematurely: osmo-stp_10.42.42.5(pid=17543) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17543)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:56:25.430406 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:56:25.457485 run osmo-hlr_10.42.42.2(pid=17540): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17540)] 08:56:25.505054 run osmo-hlr_10.42.42.2(pid=17540): stdout: | (launched: 2022-12-09_08:56:22.254871) 08:56:25.554288 run osmo-hlr_10.42.42.2(pid=17540): stderr: | [0;m[1;31m20221209085622431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085622431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085622431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085622431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085622431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085622431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085622443 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085622451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085622451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085622451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:25.604040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17533): Terminating (SIGTERM) 08:56:25.644024 run iperf3-srv_10.42.42.10(pid=17534): Terminating (SIGTERM) 08:56:25.683757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17535): Terminating (SIGTERM) 08:56:25.723599 run iperf3-srv_10.42.42.10(pid=17536): Terminating (SIGTERM) 08:56:25.763050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17539): Terminating (SIGTERM) 08:56:25.802762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17542): Terminating (SIGTERM) 08:56:25.842467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17545): Terminating (SIGTERM) 08:56:25.882424 --- ParallelTerminationStrategy: PID 17533 died... 08:56:25.901100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17533): Terminated: ok {rc=0} 08:56:25.944907 --- ParallelTerminationStrategy: PID 17534 died... 08:56:25.963520 run iperf3-srv_10.42.42.10(pid=17534): Terminated {rc=256} 08:56:26.007160 --- ParallelTerminationStrategy: PID 17535 died... 08:56:26.025791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17535): Terminated: ok {rc=0} 08:56:26.069499 --- ParallelTerminationStrategy: PID 17536 died... 08:56:26.088122 run iperf3-srv_10.42.42.10(pid=17536): Terminated {rc=256} 08:56:26.131732 --- ParallelTerminationStrategy: PID 17539 died... 08:56:26.150428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17539): Terminated: ok {rc=0} 08:56:26.194249 --- ParallelTerminationStrategy: PID 17542 died... 08:56:26.212993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17542): Terminated: ok {rc=0} 08:56:26.256789 --- ParallelTerminationStrategy: PID 17545 died... 08:56:26.275476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17545): Terminated: ok {rc=0} 08:56:26.360906 bus /gobi_0: Setting Powered False 08:56:27.460562 bus /gobi_0: Setting Powered False 08:56:28.575135 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:56:29.722772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:29.734820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:56:29.813112 tst iperf3.py: using LAC 20347 08:56:29.933892 tst iperf3.py: using RAC 202 08:56:30.054834 tst iperf3.py: using CellId 20347 08:56:30.174940 tst iperf3.py: using BVCI 20348 08:56:30.287436 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.298649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.309705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.320697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.331645 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.342601 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.353700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.364529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:30.375668 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:56:30.495431 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:56:30.718050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:31.051476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17547): Launched 08:56:31.333183 run iperf3-srv_10.42.42.10(pid=17548): Launched 08:56:31.463019 tst iperf3.py:8: start network... 08:56:31.676075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:32.166372 run create_hlr_db(pid=17549): Launched 08:56:32.312475 bus /gobi_6: Setting Powered False 08:56:33.376644 run create_hlr_db(pid=17549): Terminated: ok {rc=0} 08:56:33.815103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17551): Launched 08:56:34.122488 run osmo-hlr_10.42.42.2(pid=17552): Launched 08:56:34.239338 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:34.785616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17554): Launched 08:56:35.091526 run osmo-stp_10.42.42.5(pid=17555): Launched 08:56:35.208256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:35.737557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17557): Launched 08:56:35.854730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:36.113841 run patchelf(pid=17558): Launched 08:56:36.283918 run osmo-stp_10.42.42.5(pid=17555): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17555)] 08:56:36.413431 run osmo-stp_10.42.42.5(pid=17555): stdout: | (launched: 2022-12-09_08:56:35.035276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:36.544888 run osmo-stp_10.42.42.5(pid=17555): stderr: | [0;m[38;5;43m20221209085635206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085635206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085635207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085635207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085635207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085635208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085635208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:36.677376 run osmo-stp_10.42.42.5(pid=17555): stdout: | (launched: 2022-12-09_08:56:35.035276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:36.803149 run osmo-stp_10.42.42.5(pid=17555): stderr: | [0;m[38;5;43m20221209085635206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085635206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085635207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085635207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085635207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085635208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085635208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:36.952881 run patchelf(pid=17558): Terminating (SIGINT) 08:56:37.125870 run patchelf(pid=17558): Terminated: ok {rc=0} 08:56:37.250466 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17555): Process ended prematurely: osmo-stp_10.42.42.5(pid=17555) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17555)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 08:56:37.259940 tst iperf3.py:8: Test FAILED (7.6 sec) 08:56:37.287246 run osmo-hlr_10.42.42.2(pid=17552): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17552)] 08:56:37.335438 run osmo-hlr_10.42.42.2(pid=17552): stdout: | (launched: 2022-12-09_08:56:34.065786) 08:56:37.385061 run osmo-hlr_10.42.42.2(pid=17552): stderr: | [0;m[1;31m20221209085634240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085634240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085634241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085634241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085634241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085634241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085634253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085634261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085634261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085634261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:37.435033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17547): Terminating (SIGTERM) 08:56:37.475279 run iperf3-srv_10.42.42.10(pid=17548): Terminating (SIGTERM) 08:56:37.515292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17551): Terminating (SIGTERM) 08:56:37.555611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17554): Terminating (SIGTERM) 08:56:37.595747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17557): Terminating (SIGTERM) 08:56:37.636052 --- ParallelTerminationStrategy: PID 17547 died... 08:56:37.655290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17547): Terminated: ok {rc=0} 08:56:37.699944 --- ParallelTerminationStrategy: PID 17548 died... 08:56:37.718823 run iperf3-srv_10.42.42.10(pid=17548): Terminated {rc=256} 08:56:37.762684 --- ParallelTerminationStrategy: PID 17551 died... 08:56:37.782021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17551): Terminated: ok {rc=0} 08:56:37.826166 --- ParallelTerminationStrategy: PID 17554 died... 08:56:37.844881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17554): Terminated: ok {rc=0} 08:56:37.889453 --- ParallelTerminationStrategy: PID 17557 died... 08:56:37.908040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17557): Terminated: ok {rc=0} 08:56:37.995144 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:56:39.142468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.154460 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:56:39.224791 tst iperf3m4.py: using LAC 20348 08:56:39.344721 tst iperf3m4.py: using RAC 203 08:56:39.465606 tst iperf3m4.py: using CellId 20348 08:56:39.587573 tst iperf3m4.py: using BVCI 20349 08:56:39.700012 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.711245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.722384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.733375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.744230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.755225 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.766405 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.777266 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:39.788690 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:56:39.911629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:56:40.034032 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:56:40.154705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:56:40.278508 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:56:40.500605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:40.830113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17559): Launched 08:56:41.117141 run iperf3-srv_10.42.42.10(pid=17560): Launched 08:56:41.241136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:56:41.463407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:41.793726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Launched 08:56:42.079727 run iperf3-srv_10.42.42.10(pid=17562): Launched 08:56:42.202818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:56:42.424158 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:42.753611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17563): Launched 08:56:43.039685 run iperf3-srv_10.42.42.10(pid=17564): Launched 08:56:43.162477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:56:43.384515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:56:43.714058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17565): Launched 08:56:44.000629 run iperf3-srv_10.42.42.10(pid=17566): Launched 08:56:44.123352 tst iperf3m4.py:8: start network... 08:56:44.345355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:44.855539 run create_hlr_db(pid=17567): Launched 08:56:44.980158 bus /gobi_6: Setting Powered False 08:56:46.043205 run create_hlr_db(pid=17567): Terminated: ok {rc=0} 08:56:46.508542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17569): Launched 08:56:46.931554 run osmo-hlr_10.42.42.2(pid=17570): Launched 08:56:47.239234 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:47.768479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17572): Launched 08:56:48.076788 run osmo-stp_10.42.42.5(pid=17573): Launched 08:56:48.194562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:48.725558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17575): Launched 08:56:48.842452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:49.102143 run patchelf(pid=17576): Launched 08:56:49.272416 run osmo-stp_10.42.42.5(pid=17573): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17573)] 08:56:49.402123 run osmo-stp_10.42.42.5(pid=17573): stdout: | (launched: 2022-12-09_08:56:48.019932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:49.535204 run osmo-stp_10.42.42.5(pid=17573): stderr: | [0;m[38;5;43m20221209085648188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085648188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085648188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085648189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085648189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085648189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085648190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:49.666795 run osmo-stp_10.42.42.5(pid=17573): stdout: | (launched: 2022-12-09_08:56:48.019932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:49.792596 run osmo-stp_10.42.42.5(pid=17573): stderr: | [0;m[38;5;43m20221209085648188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085648188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085648188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085648189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085648189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085648189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085648190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:49.941776 run patchelf(pid=17576): Terminating (SIGINT) 08:56:50.114023 run patchelf(pid=17576): Terminated: ok {rc=0} 08:56:50.238153 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17573): Process ended prematurely: osmo-stp_10.42.42.5(pid=17573) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17573)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:56:50.247560 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:56:50.274941 run osmo-hlr_10.42.42.2(pid=17570): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17570)] 08:56:50.322222 run osmo-hlr_10.42.42.2(pid=17570): stdout: | (launched: 2022-12-09_08:56:46.859178) 08:56:50.371095 run osmo-hlr_10.42.42.2(pid=17570): stderr: | [0;m[1;31m20221209085647071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085647071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085647071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085647071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085647071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085647071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085647083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085647096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085647096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085647096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:50.420693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17559): Terminating (SIGTERM) 08:56:50.460357 run iperf3-srv_10.42.42.10(pid=17560): Terminating (SIGTERM) 08:56:50.499902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Terminating (SIGTERM) 08:56:50.539623 run iperf3-srv_10.42.42.10(pid=17562): Terminating (SIGTERM) 08:56:50.580481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17563): Terminating (SIGTERM) 08:56:50.620442 run iperf3-srv_10.42.42.10(pid=17564): Terminating (SIGTERM) 08:56:50.659993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17565): Terminating (SIGTERM) 08:56:50.700039 run iperf3-srv_10.42.42.10(pid=17566): Terminating (SIGTERM) 08:56:50.739828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17569): Terminating (SIGTERM) 08:56:50.779335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17572): Terminating (SIGTERM) 08:56:50.818723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17575): Terminating (SIGTERM) 08:56:50.858285 --- ParallelTerminationStrategy: PID 17559 died... 08:56:50.877145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17559): Terminated: ok {rc=0} 08:56:50.921442 --- ParallelTerminationStrategy: PID 17560 died... 08:56:50.939912 run iperf3-srv_10.42.42.10(pid=17560): Terminated {rc=256} 08:56:50.983302 --- ParallelTerminationStrategy: PID 17561 died... 08:56:51.001880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17561): Terminated: ok {rc=0} 08:56:51.045505 --- ParallelTerminationStrategy: PID 17562 died... 08:56:51.063969 run iperf3-srv_10.42.42.10(pid=17562): Terminated {rc=256} 08:56:51.107087 --- ParallelTerminationStrategy: PID 17563 died... 08:56:51.125706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17563): Terminated: ok {rc=0} 08:56:51.169127 --- ParallelTerminationStrategy: PID 17564 died... 08:56:51.187565 run iperf3-srv_10.42.42.10(pid=17564): Terminated {rc=256} 08:56:51.230883 --- ParallelTerminationStrategy: PID 17565 died... 08:56:51.249482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17565): Terminated: ok {rc=0} 08:56:51.292853 --- ParallelTerminationStrategy: PID 17566 died... 08:56:51.311674 run iperf3-srv_10.42.42.10(pid=17566): Terminated {rc=256} 08:56:51.355055 --- ParallelTerminationStrategy: PID 17569 died... 08:56:51.373655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17569): Terminated: ok {rc=0} 08:56:51.417321 --- ParallelTerminationStrategy: PID 17572 died... 08:56:51.435900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17572): Terminated: ok {rc=0} 08:56:51.479381 --- ParallelTerminationStrategy: PID 17575 died... 08:56:51.498021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17575): Terminated: ok {rc=0} 08:56:51.580441 bus /gobi_4: Setting Powered False 08:56:52.678456 bus /gobi_4: Setting Powered False 08:56:53.796389 bus /gobi_1: Setting Powered False 08:56:54.894690 bus /gobi_1: Setting Powered False 08:56:56.009996 bus /gobi_0: Setting Powered False 08:56:57.104530 bus /gobi_0: Setting Powered False 08:56:58.221211 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:56:59.324115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.336205 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:56:59.408467 tst ping.py: using LAC 20349 08:56:59.528037 tst ping.py: using RAC 204 08:56:59.647529 tst ping.py: using CellId 20349 08:56:59.771240 tst ping.py: using BVCI 20350 08:56:59.881380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.892475 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.903593 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.914653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.925579 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.936455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.947538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:56:59.958504 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:00.077243 tst ping.py:19: start network... 08:57:00.295408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:00.795882 run create_hlr_db(pid=17577): Launched 08:57:00.958791 bus /gobi_6: Setting Powered False 08:57:02.021478 run create_hlr_db(pid=17577): Terminated: ok {rc=0} 08:57:02.486641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17579): Launched 08:57:02.811436 run osmo-hlr_10.42.42.2(pid=17580): Launched 08:57:02.934825 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:03.491184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17582): Launched 08:57:03.812845 run osmo-stp_10.42.42.5(pid=17583): Launched 08:57:03.936109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:04.493331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17585): Launched 08:57:04.616913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:04.888892 run patchelf(pid=17586): Launched 08:57:05.068093 run osmo-stp_10.42.42.5(pid=17583): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17583)] 08:57:05.204602 run osmo-stp_10.42.42.5(pid=17583): stdout: | (launched: 2022-12-09_08:57:03.753727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:05.342881 run osmo-stp_10.42.42.5(pid=17583): stderr: | [0;m[38;5;43m20221209085703943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085703943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085703943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085703944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085703944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085703944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085703944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:05.480573 run osmo-stp_10.42.42.5(pid=17583): stdout: | (launched: 2022-12-09_08:57:03.753727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:05.612897 run osmo-stp_10.42.42.5(pid=17583): stderr: | [0;m[38;5;43m20221209085703943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085703943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085703943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085703944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085703944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085703944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085703944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:05.769533 run patchelf(pid=17586): Terminating (SIGINT) 08:57:05.949612 run patchelf(pid=17586): Terminated: ok {rc=0} 08:57:06.079518 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17583): Process ended prematurely: osmo-stp_10.42.42.5(pid=17583) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17583)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 08:57:06.089058 tst ping.py:22: Test FAILED (6.8 sec) 08:57:06.117716 run osmo-hlr_10.42.42.2(pid=17580): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17580)] 08:57:06.167974 run osmo-hlr_10.42.42.2(pid=17580): stdout: | (launched: 2022-12-09_08:57:02.752364) 08:57:06.220298 run osmo-hlr_10.42.42.2(pid=17580): stderr: | [0;m[1;31m20221209085702947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085702947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085702947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085702947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085702947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085702948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085702980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085702989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085702989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085702989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:06.272708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17579): Terminating (SIGTERM) 08:57:06.314666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17582): Terminating (SIGTERM) 08:57:06.357469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17585): Terminating (SIGTERM) 08:57:06.400246 --- ParallelTerminationStrategy: PID 17579 died... 08:57:06.420841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17579): Terminated: ok {rc=0} 08:57:06.464913 --- ParallelTerminationStrategy: PID 17582 died... 08:57:06.484108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17582): Terminated: ok {rc=0} 08:57:06.528688 --- ParallelTerminationStrategy: PID 17585 died... 08:57:06.547415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17585): Terminated: ok {rc=0} 08:57:06.634717 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:57:07.724002 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:07.736502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:57:07.810893 tst ping_idle_ping.py: using LAC 20350 08:57:07.936775 tst ping_idle_ping.py: using RAC 205 08:57:08.062704 tst ping_idle_ping.py: using CellId 20350 08:57:08.190316 tst ping_idle_ping.py: using BVCI 20351 08:57:08.309538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:08.321431 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:08.332834 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:08.344627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:08.356351 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:08.368225 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:08.380024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:57:08.391670 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:57:08.510698 tst ping_idle_ping.py:24: start network... 08:57:08.715333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:09.194355 run create_hlr_db(pid=17587): Launched 08:57:09.320530 bus /gobi_6: Setting Powered False 08:57:10.381627 run create_hlr_db(pid=17587): Terminated: ok {rc=0} 08:57:10.805069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17589): Launched 08:57:11.110307 run osmo-hlr_10.42.42.2(pid=17590): Launched 08:57:11.227609 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:11.763561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17592): Launched 08:57:12.065617 run osmo-stp_10.42.42.5(pid=17593): Launched 08:57:12.180663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:12.700756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17595): Launched 08:57:12.816164 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:13.072048 run patchelf(pid=17596): Launched 08:57:13.239660 run osmo-stp_10.42.42.5(pid=17593): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17593)] 08:57:13.367280 run osmo-stp_10.42.42.5(pid=17593): stdout: | (launched: 2022-12-09_08:57:12.010293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:13.496244 run osmo-stp_10.42.42.5(pid=17593): stderr: | [0;m[38;5;43m20221209085712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085712178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085712178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085712179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085712179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085712179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:13.625955 run osmo-stp_10.42.42.5(pid=17593): stdout: | (launched: 2022-12-09_08:57:12.010293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:13.749823 run osmo-stp_10.42.42.5(pid=17593): stderr: | [0;m[38;5;43m20221209085712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085712178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085712178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085712179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085712179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085712179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:13.896757 run patchelf(pid=17596): Terminating (SIGINT) 08:57:14.065675 run patchelf(pid=17596): Terminated: ok {rc=0} 08:57:14.187330 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17593): Process ended prematurely: osmo-stp_10.42.42.5(pid=17593) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17593)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:57:14.196386 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:57:14.223218 run osmo-hlr_10.42.42.2(pid=17590): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17590)] 08:57:14.270697 run osmo-hlr_10.42.42.2(pid=17590): stdout: | (launched: 2022-12-09_08:57:11.054473) 08:57:14.320136 run osmo-hlr_10.42.42.2(pid=17590): stderr: | [0;m[1;31m20221209085711229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085711229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085711229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085711229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085711229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085711229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085711241 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085711250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085711250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085711250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:14.370016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17589): Terminating (SIGTERM) 08:57:14.410164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17592): Terminating (SIGTERM) 08:57:14.450320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17595): Terminating (SIGTERM) 08:57:14.490668 --- ParallelTerminationStrategy: PID 17589 died... 08:57:14.509370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17589): Terminated: ok {rc=0} 08:57:14.553300 --- ParallelTerminationStrategy: PID 17592 died... 08:57:14.572049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17592): Terminated: ok {rc=0} 08:57:14.616116 --- ParallelTerminationStrategy: PID 17595 died... 08:57:14.634778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17595): Terminated: ok {rc=0} 08:57:14.720536 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:57:16.058516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:57:16.067899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:57:16.111044 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:57:16.159495 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:57:16.263100 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:57:16.310449 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:57:16.365105 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:57:16.939224 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:57:17.002870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.017649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:57:17.089959 tst cs_paging_gprs_active.py: using LAC 20351 08:57:17.221798 tst cs_paging_gprs_active.py: using RAC 206 08:57:17.355979 tst cs_paging_gprs_active.py: using CellId 20351 08:57:17.484272 tst cs_paging_gprs_active.py: using BVCI 20352 08:57:17.598796 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.610299 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.621595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.633269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.644908 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.656608 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.668376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.679803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:17.691443 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:57:17.815303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:57:17.937250 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:57:18.159854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:18.490141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17603): Launched 08:57:18.776349 run iperf3-srv_10.42.42.10(pid=17604): Launched 08:57:18.899790 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:57:19.122541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:19.453085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17605): Launched 08:57:19.738952 run iperf3-srv_10.42.42.10(pid=17606): Launched 08:57:19.862275 tst cs_paging_gprs_active.py:38: start network... 08:57:20.084852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:20.597633 run create_hlr_db(pid=17607): Launched 08:57:20.723846 bus /gobi_6: Setting Powered False 08:57:21.789069 run create_hlr_db(pid=17607): Terminated: ok {rc=0} 08:57:22.246007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17609): Launched 08:57:22.575313 run osmo-hlr_10.42.42.2(pid=17610): Launched 08:57:22.701221 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:23.265188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17612): Launched 08:57:23.593709 run osmo-stp_10.42.42.5(pid=17613): Launched 08:57:23.720398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:24.285960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17615): Launched 08:57:24.411794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:24.689493 run patchelf(pid=17616): Launched 08:57:24.872587 run osmo-stp_10.42.42.5(pid=17613): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17613)] 08:57:25.011353 run osmo-stp_10.42.42.5(pid=17613): stdout: | (launched: 2022-12-09_08:57:23.534407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:25.151430 run osmo-stp_10.42.42.5(pid=17613): stderr: | [0;m[38;5;43m20221209085723724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085723724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085723725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085723725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085723725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085723726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085723726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:25.291857 run osmo-stp_10.42.42.5(pid=17613): stdout: | (launched: 2022-12-09_08:57:23.534407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:25.426176 run osmo-stp_10.42.42.5(pid=17613): stderr: | [0;m[38;5;43m20221209085723724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085723724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085723725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085723725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085723725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085723726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085723726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:25.585193 run patchelf(pid=17616): Terminating (SIGINT) 08:57:25.768062 run patchelf(pid=17616): Terminated: ok {rc=0} 08:57:25.900470 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17613): Process ended prematurely: osmo-stp_10.42.42.5(pid=17613) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17613)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:57:25.910583 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 08:57:25.939293 run osmo-hlr_10.42.42.2(pid=17610): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17610)] 08:57:25.989728 run osmo-hlr_10.42.42.2(pid=17610): stdout: | (launched: 2022-12-09_08:57:22.515434) 08:57:26.041628 run osmo-hlr_10.42.42.2(pid=17610): stderr: | [0;m[1;31m20221209085722710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085722710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085722710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085722710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085722710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085722710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085722721 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085722729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085722730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085722730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:26.094068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17603): Terminating (SIGTERM) 08:57:26.136121 run iperf3-srv_10.42.42.10(pid=17604): Terminating (SIGTERM) 08:57:26.178261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17605): Terminating (SIGTERM) 08:57:26.220645 run iperf3-srv_10.42.42.10(pid=17606): Terminating (SIGTERM) 08:57:26.262823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17609): Terminating (SIGTERM) 08:57:26.305025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17612): Terminating (SIGTERM) 08:57:26.347191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17615): Terminating (SIGTERM) 08:57:26.389453 --- ParallelTerminationStrategy: PID 17603 died... 08:57:26.409409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17603): Terminated: ok {rc=0} 08:57:26.456097 --- ParallelTerminationStrategy: PID 17604 died... 08:57:26.475776 run iperf3-srv_10.42.42.10(pid=17604): Terminated {rc=256} 08:57:26.522185 --- ParallelTerminationStrategy: PID 17605 died... 08:57:26.541801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17605): Terminated: ok {rc=0} 08:57:26.588198 --- ParallelTerminationStrategy: PID 17606 died... 08:57:26.607670 run iperf3-srv_10.42.42.10(pid=17606): Terminated {rc=256} 08:57:26.653976 --- ParallelTerminationStrategy: PID 17609 died... 08:57:26.673478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17609): Terminated: ok {rc=0} 08:57:26.719844 --- ParallelTerminationStrategy: PID 17612 died... 08:57:26.739392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17612): Terminated: ok {rc=0} 08:57:26.785677 --- ParallelTerminationStrategy: PID 17615 died... 08:57:26.805296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17615): Terminated: ok {rc=0} 08:57:26.892804 bus /gobi_0: Setting Powered False 08:57:27.991780 bus /gobi_0: Setting Powered False 08:57:29.107242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:57:30.254386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.266334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:57:30.340319 tst iperf3.py: using LAC 20352 08:57:30.459237 tst iperf3.py: using RAC 207 08:57:30.583891 tst iperf3.py: using CellId 20352 08:57:30.704758 tst iperf3.py: using BVCI 20353 08:57:30.818477 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.829863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.854090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.866256 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.878272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.891760 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.909604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.927543 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:30.940530 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:57:31.061797 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:57:31.293390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:31.610001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17617): Launched 08:57:31.893544 run iperf3-srv_10.42.42.10(pid=17618): Launched 08:57:32.026652 tst iperf3.py:8: start network... 08:57:32.237370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:32.716431 run create_hlr_db(pid=17619): Launched 08:57:32.841698 bus /gobi_6: Setting Powered False 08:57:33.903193 run create_hlr_db(pid=17619): Terminated: ok {rc=0} 08:57:34.330946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17621): Launched 08:57:34.638122 run osmo-hlr_10.42.42.2(pid=17622): Launched 08:57:34.754372 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:35.284043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17624): Launched 08:57:35.592380 run osmo-stp_10.42.42.5(pid=17625): Launched 08:57:35.710289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:36.246663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17629): Launched 08:57:36.364098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:36.624732 run patchelf(pid=17630): Launched 08:57:36.795415 run osmo-stp_10.42.42.5(pid=17625): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17625)] 08:57:36.925629 run osmo-stp_10.42.42.5(pid=17625): stdout: | (launched: 2022-12-09_08:57:35.535933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:37.057756 run osmo-stp_10.42.42.5(pid=17625): stderr: | [0;m[38;5;43m20221209085735704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085735704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085735704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085735705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085735705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085735705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085735705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:37.190718 run osmo-stp_10.42.42.5(pid=17625): stdout: | (launched: 2022-12-09_08:57:35.535933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:37.317094 run osmo-stp_10.42.42.5(pid=17625): stderr: | [0;m[38;5;43m20221209085735704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085735704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085735704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085735705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085735705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085735705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085735705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:37.466855 run patchelf(pid=17630): Terminating (SIGINT) 08:57:37.639887 run patchelf(pid=17630): Terminated: ok {rc=0} 08:57:37.764310 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17625): Process ended prematurely: osmo-stp_10.42.42.5(pid=17625) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17625)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 08:57:37.773895 tst iperf3.py:8: Test FAILED (7.6 sec) 08:57:37.800858 run osmo-hlr_10.42.42.2(pid=17622): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17622)] 08:57:37.848586 run osmo-hlr_10.42.42.2(pid=17622): stdout: | (launched: 2022-12-09_08:57:34.581333) 08:57:37.897756 run osmo-hlr_10.42.42.2(pid=17622): stderr: | [0;m[1;31m20221209085734756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085734756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085734756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085734756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085734756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085734756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085734781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085734791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085734791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085734791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:37.947240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17617): Terminating (SIGTERM) 08:57:37.986799 run iperf3-srv_10.42.42.10(pid=17618): Terminating (SIGTERM) 08:57:38.026284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17621): Terminating (SIGTERM) 08:57:38.065855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17624): Terminating (SIGTERM) 08:57:38.105431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17629): Terminating (SIGTERM) 08:57:38.145273 --- ParallelTerminationStrategy: PID 17617 died... 08:57:38.164292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17617): Terminated: ok {rc=0} 08:57:38.208336 --- ParallelTerminationStrategy: PID 17618 died... 08:57:38.226742 run iperf3-srv_10.42.42.10(pid=17618): Terminated {rc=256} 08:57:38.270566 --- ParallelTerminationStrategy: PID 17621 died... 08:57:38.289079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17621): Terminated: ok {rc=0} 08:57:38.332639 --- ParallelTerminationStrategy: PID 17624 died... 08:57:38.351282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17624): Terminated: ok {rc=0} 08:57:38.394549 --- ParallelTerminationStrategy: PID 17629 died... 08:57:38.412913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17629): Terminated: ok {rc=0} 08:57:38.498728 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:57:39.646254 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:39.658064 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:57:39.734531 tst iperf3m4.py: using LAC 20353 08:57:39.854262 tst iperf3m4.py: using RAC 208 08:57:39.983865 tst iperf3m4.py: using CellId 20353 08:57:40.111242 tst iperf3m4.py: using BVCI 20354 08:57:40.231847 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.243715 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.255419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.267289 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.280017 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.292929 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.304670 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.317001 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:40.329580 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:57:40.452004 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:57:40.576932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:57:40.696135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:57:40.819828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:57:41.027391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:41.338015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17631): Launched 08:57:41.607027 run iperf3-srv_10.42.42.10(pid=17632): Launched 08:57:41.722549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:57:41.928336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:42.236529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17633): Launched 08:57:42.504924 run iperf3-srv_10.42.42.10(pid=17634): Launched 08:57:42.619795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:57:42.825412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:43.134352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17635): Launched 08:57:43.403511 run iperf3-srv_10.42.42.10(pid=17636): Launched 08:57:43.518697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:57:43.724195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:57:44.032440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17637): Launched 08:57:44.299193 run iperf3-srv_10.42.42.10(pid=17638): Launched 08:57:44.415460 tst iperf3m4.py:8: start network... 08:57:44.620786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:45.098402 run create_hlr_db(pid=17639): Launched 08:57:45.225704 bus /gobi_6: Setting Powered False 08:57:46.286002 run create_hlr_db(pid=17639): Terminated: ok {rc=0} 08:57:46.723006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Launched 08:57:47.048941 run osmo-hlr_10.42.42.2(pid=17642): Launched 08:57:47.223429 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:47.794105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Launched 08:57:48.123962 run osmo-stp_10.42.42.5(pid=17645): Launched 08:57:48.250394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:57:48.817986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17647): Launched 08:57:48.943832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:57:49.221420 run patchelf(pid=17648): Launched 08:57:49.402752 run osmo-stp_10.42.42.5(pid=17645): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] 08:57:49.541175 run osmo-stp_10.42.42.5(pid=17645): stdout: | (launched: 2022-12-09_08:57:48.063783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:49.681157 run osmo-stp_10.42.42.5(pid=17645): stderr: | [0;m[38;5;43m20221209085748250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085748250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085748251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085748251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085748252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085748252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085748252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:49.820800 run osmo-stp_10.42.42.5(pid=17645): stdout: | (launched: 2022-12-09_08:57:48.063783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:49.955005 run osmo-stp_10.42.42.5(pid=17645): stderr: | [0;m[38;5;43m20221209085748250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085748250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085748251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085748251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085748252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085748252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085748252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:50.114068 run patchelf(pid=17648): Terminating (SIGINT) 08:57:50.298157 run patchelf(pid=17648): Terminated: ok {rc=0} 08:57:50.430749 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17645): Process ended prematurely: osmo-stp_10.42.42.5(pid=17645) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:57:50.440923 tst iperf3m4.py:8: Test FAILED (10.8 sec) 08:57:50.470201 run osmo-hlr_10.42.42.2(pid=17642): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17642)] 08:57:50.520473 run osmo-hlr_10.42.42.2(pid=17642): stdout: | (launched: 2022-12-09_08:57:46.991269) 08:57:50.572529 run osmo-hlr_10.42.42.2(pid=17642): stderr: | [0;m[1;31m20221209085747241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085747241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085747241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085747241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085747241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085747241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085747253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085747261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085747261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085747261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:50.625135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17631): Terminating (SIGTERM) 08:57:50.667205 run iperf3-srv_10.42.42.10(pid=17632): Terminating (SIGTERM) 08:57:50.710616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17633): Terminating (SIGTERM) 08:57:50.752842 run iperf3-srv_10.42.42.10(pid=17634): Terminating (SIGTERM) 08:57:50.795232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17635): Terminating (SIGTERM) 08:57:50.837092 run iperf3-srv_10.42.42.10(pid=17636): Terminating (SIGTERM) 08:57:50.878655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17637): Terminating (SIGTERM) 08:57:50.920526 run iperf3-srv_10.42.42.10(pid=17638): Terminating (SIGTERM) 08:57:50.962353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Terminating (SIGTERM) 08:57:51.004192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Terminating (SIGTERM) 08:57:51.046081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17647): Terminating (SIGTERM) 08:57:51.088216 --- ParallelTerminationStrategy: PID 17631 died... 08:57:51.108240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17631): Terminated: ok {rc=0} 08:57:51.155138 --- ParallelTerminationStrategy: PID 17632 died... 08:57:51.174632 run iperf3-srv_10.42.42.10(pid=17632): Terminated {rc=256} 08:57:51.221527 --- ParallelTerminationStrategy: PID 17633 died... 08:57:51.240882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17633): Terminated: ok {rc=0} 08:57:51.287838 --- ParallelTerminationStrategy: PID 17634 died... 08:57:51.307351 run iperf3-srv_10.42.42.10(pid=17634): Terminated {rc=256} 08:57:51.354127 --- ParallelTerminationStrategy: PID 17635 died... 08:57:51.373463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17635): Terminated: ok {rc=0} 08:57:51.420065 --- ParallelTerminationStrategy: PID 17636 died... 08:57:51.439544 run iperf3-srv_10.42.42.10(pid=17636): Terminated {rc=256} 08:57:51.485779 --- ParallelTerminationStrategy: PID 17637 died... 08:57:51.505271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17637): Terminated: ok {rc=0} 08:57:51.551939 --- ParallelTerminationStrategy: PID 17638 died... 08:57:51.571399 run iperf3-srv_10.42.42.10(pid=17638): Terminated {rc=256} 08:57:51.617480 --- ParallelTerminationStrategy: PID 17641 died... 08:57:51.636996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17641): Terminated: ok {rc=0} 08:57:51.683132 --- ParallelTerminationStrategy: PID 17644 died... 08:57:51.702591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17644): Terminated: ok {rc=0} 08:57:51.748869 --- ParallelTerminationStrategy: PID 17647 died... 08:57:51.768612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17647): Terminated: ok {rc=0} 08:57:51.857050 bus /gobi_4: Setting Powered False 08:57:52.980264 bus /gobi_4: Setting Powered False 08:57:54.096403 bus /gobi_1: Setting Powered False 08:57:55.194481 bus /gobi_1: Setting Powered False 08:57:56.311337 bus /gobi_0: Setting Powered False 08:57:57.409438 bus /gobi_0: Setting Powered False 08:57:58.525737 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:57:59.628157 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:57:59.640647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:57:59.715478 tst ping.py: using LAC 20354 08:57:59.840716 tst ping.py: using RAC 209 08:57:59.966150 tst ping.py: using CellId 20354 08:58:00.090953 tst ping.py: using BVCI 20355 08:58:00.207296 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:00.219431 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:00.230983 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:00.242811 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:00.254512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:00.266440 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:00.278491 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:00.290532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:00.413063 tst ping.py:19: start network... 08:58:00.630366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:01.161677 run create_hlr_db(pid=17649): Launched 08:58:01.320042 bus /gobi_6: Setting Powered False 08:58:02.383841 run create_hlr_db(pid=17649): Terminated: ok {rc=0} 08:58:02.816816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17651): Launched 08:58:03.120627 run osmo-hlr_10.42.42.2(pid=17652): Launched 08:58:03.245015 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:03.807508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17654): Launched 08:58:04.127722 run osmo-stp_10.42.42.5(pid=17655): Launched 08:58:04.250509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:04.806808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17657): Launched 08:58:04.929656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:05.201274 run patchelf(pid=17658): Launched 08:58:05.379899 run osmo-stp_10.42.42.5(pid=17655): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17655)] 08:58:05.515721 run osmo-stp_10.42.42.5(pid=17655): stdout: | (launched: 2022-12-09_08:58:04.069537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:05.653253 run osmo-stp_10.42.42.5(pid=17655): stderr: | [0;m[38;5;43m20221209085804256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085804256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085804256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085804256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085804257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085804257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085804257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:05.790418 run osmo-stp_10.42.42.5(pid=17655): stdout: | (launched: 2022-12-09_08:58:04.069537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:05.922011 run osmo-stp_10.42.42.5(pid=17655): stderr: | [0;m[38;5;43m20221209085804256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085804256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085804256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085804256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085804257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085804257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085804257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:06.078022 run patchelf(pid=17658): Terminating (SIGINT) 08:58:06.258182 run patchelf(pid=17658): Terminated: ok {rc=0} 08:58:06.388113 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17655): Process ended prematurely: osmo-stp_10.42.42.5(pid=17655) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17655)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 08:58:06.397656 tst ping.py:22: Test FAILED (6.8 sec) 08:58:06.426309 run osmo-hlr_10.42.42.2(pid=17652): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17652)] 08:58:06.476516 run osmo-hlr_10.42.42.2(pid=17652): stdout: | (launched: 2022-12-09_08:58:03.063944) 08:58:06.528345 run osmo-hlr_10.42.42.2(pid=17652): stderr: | [0;m[1;31m20221209085803253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085803253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085803253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085803253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085803253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085803254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085803266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085803275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085803275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085803275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:06.580759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17651): Terminating (SIGTERM) 08:58:06.622835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17654): Terminating (SIGTERM) 08:58:06.665196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17657): Terminating (SIGTERM) 08:58:06.707446 --- ParallelTerminationStrategy: PID 17651 died... 08:58:06.727058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17651): Terminated: ok {rc=0} 08:58:06.773952 --- ParallelTerminationStrategy: PID 17654 died... 08:58:06.793676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17654): Terminated: ok {rc=0} 08:58:06.840610 --- ParallelTerminationStrategy: PID 17657 died... 08:58:06.860131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17657): Terminated: ok {rc=0} 08:58:06.947539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:58:08.035398 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.047473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:58:08.119635 tst ping_idle_ping.py: using LAC 20355 08:58:08.237931 tst ping_idle_ping.py: using RAC 210 08:58:08.356785 tst ping_idle_ping.py: using CellId 20355 08:58:08.476739 tst ping_idle_ping.py: using BVCI 20356 08:58:08.586089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.597313 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.608296 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.619391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.630316 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.641380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.652426 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:58:08.663545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:58:08.781630 tst ping_idle_ping.py:24: start network... 08:58:08.984450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:09.458405 run create_hlr_db(pid=17659): Launched 08:58:09.583820 bus /gobi_6: Setting Powered False 08:58:10.645030 run create_hlr_db(pid=17659): Terminated: ok {rc=0} 08:58:11.086717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17661): Launched 08:58:11.411991 run osmo-hlr_10.42.42.2(pid=17662): Launched 08:58:11.535734 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:12.095104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17664): Launched 08:58:12.419247 run osmo-stp_10.42.42.5(pid=17665): Launched 08:58:12.545075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:13.105723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17667): Launched 08:58:13.231574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:13.505796 run patchelf(pid=17668): Launched 08:58:13.685625 run osmo-stp_10.42.42.5(pid=17665): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17665)] 08:58:13.822548 run osmo-stp_10.42.42.5(pid=17665): stdout: | (launched: 2022-12-09_08:58:12.360258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:13.960857 run osmo-stp_10.42.42.5(pid=17665): stderr: | [0;m[38;5;43m20221209085812551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085812551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085812551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085812551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085812552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085812552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085812552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:14.099166 run osmo-stp_10.42.42.5(pid=17665): stdout: | (launched: 2022-12-09_08:58:12.360258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:14.232178 run osmo-stp_10.42.42.5(pid=17665): stderr: | [0;m[38;5;43m20221209085812551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085812551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085812551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085812551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085812552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085812552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085812552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:14.390006 run patchelf(pid=17668): Terminating (SIGINT) 08:58:14.570972 run patchelf(pid=17668): Terminated: ok {rc=0} 08:58:14.701739 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17665): Process ended prematurely: osmo-stp_10.42.42.5(pid=17665) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17665)] [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:58:14.711392 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:58:14.739626 run osmo-hlr_10.42.42.2(pid=17662): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17662)] 08:58:14.790498 run osmo-hlr_10.42.42.2(pid=17662): stdout: | (launched: 2022-12-09_08:58:11.353032) 08:58:14.842628 run osmo-hlr_10.42.42.2(pid=17662): stderr: | [0;m[1;31m20221209085811549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085811549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085811549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085811549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085811549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085811549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085811562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085811570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085811570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085811570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:14.895211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17661): Terminating (SIGTERM) 08:58:14.937505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17664): Terminating (SIGTERM) 08:58:14.979949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17667): Terminating (SIGTERM) 08:58:15.022588 --- ParallelTerminationStrategy: PID 17661 died... 08:58:15.042738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17661): Terminated: ok {rc=0} 08:58:15.089742 --- ParallelTerminationStrategy: PID 17664 died... 08:58:15.109463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17664): Terminated: ok {rc=0} 08:58:15.156243 --- ParallelTerminationStrategy: PID 17667 died... 08:58:15.175835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17667): Terminated: ok {rc=0} 08:58:15.263964 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:58:16.593655 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:16.600728 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:58:16.637085 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:58:16.673867 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:58:16.727580 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:58:16.763807 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:58:16.802782 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:58:17.358883 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:58:17.364301 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.376079 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:58:17.447339 tst switch_tch_pdch.py: using LAC 20356 08:58:17.565321 tst switch_tch_pdch.py: using RAC 211 08:58:17.683010 tst switch_tch_pdch.py: using CellId 20356 08:58:17.800627 tst switch_tch_pdch.py: using BVCI 20357 08:58:17.910108 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.921811 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.933282 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.945141 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.957214 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.969110 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.981723 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:58:17.993271 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:58:18.111961 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:58:18.235848 tst switch_tch_pdch.py:51: start network... 08:58:18.437755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:18.904599 run create_hlr_db(pid=17672): Launched 08:58:19.027258 bus /gobi_6: Setting Powered False 08:58:20.091167 run create_hlr_db(pid=17672): Terminated: ok {rc=0} 08:58:20.521611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17674): Launched 08:58:20.821613 run osmo-hlr_10.42.42.2(pid=17675): Launched 08:58:20.935272 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:21.468848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17677): Launched 08:58:21.770538 run osmo-stp_10.42.42.5(pid=17678): Launched 08:58:21.884357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:22.401952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17680): Launched 08:58:22.516145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:22.769316 run patchelf(pid=17681): Launched 08:58:22.935441 run osmo-stp_10.42.42.5(pid=17678): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17678)] 08:58:23.062029 run osmo-stp_10.42.42.5(pid=17678): stdout: | (launched: 2022-12-09_08:58:21.714681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:23.190504 run osmo-stp_10.42.42.5(pid=17678): stderr: | [0;m[38;5;43m20221209085821883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085821884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:23.319313 run osmo-stp_10.42.42.5(pid=17678): stdout: | (launched: 2022-12-09_08:58:21.714681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:23.442791 run osmo-stp_10.42.42.5(pid=17678): stderr: | [0;m[38;5;43m20221209085821883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085821884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085821884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085821885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:23.588706 run patchelf(pid=17681): Terminating (SIGINT) 08:58:23.756484 run patchelf(pid=17681): Terminated: ok {rc=0} 08:58:23.877631 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17678): Process ended prematurely: osmo-stp_10.42.42.5(pid=17678) [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17678)] [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:58:23.886427 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 08:58:23.912680 run osmo-hlr_10.42.42.2(pid=17675): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17675)] 08:58:23.960229 run osmo-hlr_10.42.42.2(pid=17675): stdout: | (launched: 2022-12-09_08:58:20.766440) 08:58:24.009059 run osmo-hlr_10.42.42.2(pid=17675): stderr: | [0;m[1;31m20221209085820940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085820940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085820940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085820940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085820940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085820940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085820952 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085820962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085820962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085820962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:24.058364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17674): Terminating (SIGTERM) 08:58:24.097855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17677): Terminating (SIGTERM) 08:58:24.137521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17680): Terminating (SIGTERM) 08:58:24.177323 --- ParallelTerminationStrategy: PID 17674 died... 08:58:24.196265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17674): Terminated: ok {rc=0} 08:58:24.239756 --- ParallelTerminationStrategy: PID 17677 died... 08:58:24.258207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17677): Terminated: ok {rc=0} 08:58:24.301895 --- ParallelTerminationStrategy: PID 17680 died... 08:58:24.320522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17680): Terminated: ok {rc=0} 08:58:24.405282 bus /gobi_0: Setting Powered False 08:58:25.503822 bus /gobi_0: Setting Powered False 08:58:26.618196 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:58:27.869356 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:27.874953 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:58:27.909150 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:58:27.944193 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:58:27.995928 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:58:28.029792 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:58:28.064470 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:58:28.624914 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:58:28.631577 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:28.644411 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:58:28.718867 tst switch_tch_pdch.py: using LAC 20357 08:58:28.843496 tst switch_tch_pdch.py: using RAC 212 08:58:28.968239 tst switch_tch_pdch.py: using CellId 20357 08:58:29.092002 tst switch_tch_pdch.py: using BVCI 20358 08:58:29.208651 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:29.220391 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:29.232295 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:29.244127 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:29.255891 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:29.267719 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:29.279549 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:58:29.291368 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:58:29.408057 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:58:29.529415 tst switch_tch_pdch.py:51: start network... 08:58:29.747414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:30.220794 run create_hlr_db(pid=17686): Launched 08:58:30.347277 bus /gobi_6: Setting Powered False 08:58:31.439319 run create_hlr_db(pid=17686): Terminated: ok {rc=0} 08:58:31.946445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17688): Launched 08:58:32.267749 run osmo-hlr_10.42.42.2(pid=17689): Launched 08:58:32.384777 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:32.891932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17691): Launched 08:58:33.192809 run osmo-stp_10.42.42.5(pid=17692): Launched 08:58:33.307676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:58:33.802665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17694): Launched 08:58:33.919486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:58:34.174046 run patchelf(pid=17695): Launched 08:58:34.343267 run osmo-stp_10.42.42.5(pid=17692): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17692)] 08:58:34.470775 run osmo-stp_10.42.42.5(pid=17692): stdout: | (launched: 2022-12-09_08:58:33.137615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:34.599929 run osmo-stp_10.42.42.5(pid=17692): stderr: | [0;m[38;5;43m20221209085833304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085833304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085833304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085833305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085833305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085833305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085833305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:34.729093 run osmo-stp_10.42.42.5(pid=17692): stdout: | (launched: 2022-12-09_08:58:33.137615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:34.852625 run osmo-stp_10.42.42.5(pid=17692): stderr: | [0;m[38;5;43m20221209085833304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085833304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085833304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085833305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085833305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085833305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085833305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:34.998876 run patchelf(pid=17695): Terminating (SIGINT) 08:58:35.168156 run patchelf(pid=17695): Terminated: ok {rc=0} 08:58:35.289660 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17692): Process ended prematurely: osmo-stp_10.42.42.5(pid=17692) [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17692)] [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:58:35.298490 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 08:58:35.324813 run osmo-hlr_10.42.42.2(pid=17689): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17689)] 08:58:35.372036 run osmo-hlr_10.42.42.2(pid=17689): stdout: | (launched: 2022-12-09_08:58:32.211720) 08:58:35.420873 run osmo-hlr_10.42.42.2(pid=17689): stderr: | [0;m[1;31m20221209085832384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085832384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085832384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085832384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085832384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085832384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085832396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085832404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085832405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085832405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:35.470172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17688): Terminating (SIGTERM) 08:58:35.509766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17691): Terminating (SIGTERM) 08:58:35.549867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17694): Terminating (SIGTERM) 08:58:35.590599 --- ParallelTerminationStrategy: PID 17688 died... 08:58:35.609610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17688): Terminated: ok {rc=0} 08:58:35.653623 --- ParallelTerminationStrategy: PID 17691 died... 08:58:35.672112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17691): Terminated: ok {rc=0} 08:58:35.715838 --- ParallelTerminationStrategy: PID 17694 died... 08:58:35.734535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17694): Terminated: ok {rc=0} 08:58:35.820737 bus /gobi_0: Setting Powered False 08:58:36.921121 bus /gobi_0: Setting Powered False 08:58:38.037081 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_sms:trx-umtrx --------------------------------------------------------------------- 08:58:39.296778 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:39.300618 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:58:39.333406 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 08:58:39.340182 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 08:58:39.392128 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:58:39.424892 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 08:58:39.431650 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 08:58:39.971049 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 08:58:39.975928 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 08:58:39.986828 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 08:58:40.033662 tst mo_mt_sms.py: using LAC 20358 08:58:40.151722 tst mo_mt_sms.py: using RAC 213 08:58:40.270013 tst mo_mt_sms.py: using CellId 20358 08:58:40.389326 tst mo_mt_sms.py: using BVCI 20359 08:58:40.498253 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:58:40.619589 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:58:40.734859 tst mo_mt_sms.py:9: start nitb and bts... 08:58:40.938511 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:58:41.557345 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17700): Launched 08:58:41.862262 run osmo-nitb_10.42.42.2(pid=17701): Launched 08:58:42.031411 run osmo-nitb_10.42.42.2(pid=17701): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17701)] 08:58:42.167242 run osmo-nitb_10.42.42.2(pid=17701): stdout: | (launched: 2022-12-09_08:58:41.806998) 08:58:42.303724 run osmo-nitb_10.42.42.2(pid=17701): stderr: | (launched: 2022-12-09_08:58:41.852109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:58:42.440369 run osmo-nitb_10.42.42.2(pid=17701): stdout: | (launched: 2022-12-09_08:58:41.806998) 08:58:42.571563 run osmo-nitb_10.42.42.2(pid=17701): stderr: | (launched: 2022-12-09_08:58:41.852109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17701): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17701) [trial-2357↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17701)] 08:58:42.977764 tst osmo-nitb_10.42.42.2(pid=17701): stdout: | (launched: 2022-12-09_08:58:41.806998) 08:58:43.099412 tst osmo-nitb_10.42.42.2(pid=17701): stderr: | (launched: 2022-12-09_08:58:41.852109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:58:43.242973 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17701): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17701) [trial-2357↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17701)] [trial-2357↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 08:58:43.251358 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 08:58:43.257932 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17700): Terminating (SIGTERM) 08:58:43.466500 --- ParallelTerminationStrategy: PID 17700 died... 08:58:43.487207 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17700): Terminated: ok {rc=0} 08:58:43.572758 bus /sierra_3: Setting Powered False 08:58:44.672565 bus /sierra_3: Setting Powered False 08:58:45.790470 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:trx-umtrx --------------------------------------------------------------------- 08:58:47.030567 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:47.039011 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:58:47.085285 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:58:47.122576 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 08:58:47.185515 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:58:47.221622 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:58:47.251666 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 08:58:47.797972 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 08:58:47.803059 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:58:47.814225 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 08:58:47.862743 tst mo_mt_sms.py: using LAC 20359 08:58:47.990643 tst mo_mt_sms.py: using RAC 214 08:58:48.116543 tst mo_mt_sms.py: using CellId 20359 08:58:48.242241 tst mo_mt_sms.py: using BVCI 20360 08:58:48.354507 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:58:48.365579 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:58:48.376331 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:58:48.387746 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:58:48.399422 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:58:48.410736 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:58:48.526636 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:58:48.643116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:49.110623 run create_hlr_db(pid=17705): Launched 08:58:49.234148 bus /sierra_2: Setting Powered False 08:58:50.294158 run create_hlr_db(pid=17705): Terminated: ok {rc=0} 08:58:50.732433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17707): Launched 08:58:51.055441 run osmo-hlr_10.42.42.2(pid=17708): Launched 08:58:51.178706 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:51.736655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17710): Launched 08:58:52.058525 run osmo-stp_10.42.42.5(pid=17711): Launched 08:58:52.181355 run osmo-msc_10.42.42.6: Starting osmo-msc 08:58:52.764530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17713): Launched 08:58:53.086095 run osmo-msc_10.42.42.6(pid=17714): Launched 08:58:53.267285 run osmo-stp_10.42.42.5(pid=17711): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17711)] 08:58:53.403279 run osmo-stp_10.42.42.5(pid=17711): stdout: | (launched: 2022-12-09_08:58:51.999391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:53.539702 run osmo-stp_10.42.42.5(pid=17711): stderr: | [0;m[38;5;43m20221209085852188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085852188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085852189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085852189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085852190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085852190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085852190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:53.674715 run osmo-stp_10.42.42.5(pid=17711): stdout: | (launched: 2022-12-09_08:58:51.999391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:53.803235 run osmo-stp_10.42.42.5(pid=17711): stderr: | [0;m[38;5;43m20221209085852188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085852188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085852189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085852189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085852190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085852190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085852190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:53.956835 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17711): Process ended prematurely: osmo-stp_10.42.42.5(pid=17711) [trial-2357↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17711)] [trial-2357↪sms:trx-umtrx↪mo_mt_sms.py:16] 08:58:53.966056 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 08:58:53.993906 run osmo-hlr_10.42.42.2(pid=17708): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17708)] 08:58:54.044225 run osmo-hlr_10.42.42.2(pid=17708): stdout: | (launched: 2022-12-09_08:58:50.996933) 08:58:54.096546 run osmo-hlr_10.42.42.2(pid=17708): stderr: | [0;m[1;31m20221209085851190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085851190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085851190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085851191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085851191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085851191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085851206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085851214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085851215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085851215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:54.169269 run osmo-msc_10.42.42.6(pid=17714): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17714)] 08:58:54.219592 run osmo-msc_10.42.42.6(pid=17714): stdout: | (launched: 2022-12-09_08:58:53.027485) 08:58:54.272106 run osmo-msc_10.42.42.6(pid=17714): stderr: | [0;m[38;5;43m20221209085853346 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085853346 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f51e08b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085853346 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085853346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085853347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085853347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085853348 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085853349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085853349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085853349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:58:54.324892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17707): Terminating (SIGTERM) 08:58:54.367024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17710): Terminating (SIGTERM) 08:58:54.409188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17713): Terminating (SIGTERM) 08:58:54.451874 --- ParallelTerminationStrategy: PID 17707 died... 08:58:54.471968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17707): Terminated: ok {rc=0} 08:58:54.519044 --- ParallelTerminationStrategy: PID 17710 died... 08:58:54.538812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17710): Terminated: ok {rc=0} 08:58:54.585421 --- ParallelTerminationStrategy: PID 17713 died... 08:58:54.605086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17713): Terminated: ok {rc=0} 08:58:54.693461 bus /sierra_3: Setting Powered False 08:58:55.792877 bus /sierra_3: Setting Powered False 08:58:56.910456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 08:58:58.149923 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:58.154077 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:58:58.188385 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 08:58:58.195660 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 08:58:58.233792 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:58:58.268869 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 08:58:58.276079 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 08:58:58.794703 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 08:58:58.800197 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 08:58:58.811700 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 08:58:58.863607 tst assert_extension.py: using LAC 20360 08:58:58.990641 tst assert_extension.py: using RAC 215 08:58:59.116850 tst assert_extension.py: using CellId 20360 08:58:59.244592 tst assert_extension.py: using BVCI 20361 08:58:59.355399 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 08:58:59.473918 tst assert_extension.py:10: start nitb and bts... 08:58:59.681648 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:59:00.298993 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17719): Launched 08:59:00.601084 run osmo-nitb_10.42.42.2(pid=17720): Launched 08:59:00.768391 run osmo-nitb_10.42.42.2(pid=17720): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17720)] 08:59:00.928650 run osmo-nitb_10.42.42.2(pid=17720): stdout: | (launched: 2022-12-09_08:59:00.545368) 08:59:01.067612 run osmo-nitb_10.42.42.2(pid=17720): stderr: | (launched: 2022-12-09_08:59:00.590724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:59:01.207202 run osmo-nitb_10.42.42.2(pid=17720): stdout: | (launched: 2022-12-09_08:59:00.545368) 08:59:01.341706 run osmo-nitb_10.42.42.2(pid=17720): stderr: | (launched: 2022-12-09_08:59:00.590724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17720): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17720) [trial-2357↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17720)] 08:59:01.714549 tst osmo-nitb_10.42.42.2(pid=17720): stdout: | (launched: 2022-12-09_08:59:00.545368) 08:59:01.891399 tst osmo-nitb_10.42.42.2(pid=17720): stderr: | (launched: 2022-12-09_08:59:00.590724) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:59:02.079317 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17720): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17720) [trial-2357↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17720)] [trial-2357↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 08:59:02.088600 tst assert_extension.py:12: Test FAILED (3.3 sec) 08:59:02.096065 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17719): Terminating (SIGTERM) 08:59:02.310214 --- ParallelTerminationStrategy: PID 17719 died... 08:59:02.332697 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17719): Terminated: ok {rc=0} 08:59:02.420250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:trx-umtrx --------------------------------------------------------------------- 08:59:03.602089 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:03.606985 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:59:03.641932 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:59:03.670220 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 08:59:03.705847 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:59:03.740519 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:59:03.769379 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 08:59:04.298445 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 08:59:04.303999 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:04.315376 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 08:59:04.367737 tst assert_extension.py: using LAC 20361 08:59:04.494164 tst assert_extension.py: using RAC 216 08:59:04.622317 tst assert_extension.py: using CellId 20361 08:59:04.748143 tst assert_extension.py: using BVCI 20362 08:59:04.866713 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:04.878226 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:04.889565 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:04.901067 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:04.912516 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:04.924017 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 08:59:05.045375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:05.546721 run create_hlr_db(pid=17724): Launched 08:59:05.670855 bus /sierra_2: Setting Powered False 08:59:06.734117 run create_hlr_db(pid=17724): Terminated: ok {rc=0} 08:59:07.165400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17726): Launched 08:59:07.467542 run osmo-hlr_10.42.42.2(pid=17727): Launched 08:59:07.587039 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:08.113942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17729): Launched 08:59:08.415601 run osmo-stp_10.42.42.5(pid=17730): Launched 08:59:08.530848 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:09.075327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17732): Launched 08:59:09.376535 run osmo-msc_10.42.42.6(pid=17733): Launched 08:59:09.545998 run osmo-stp_10.42.42.5(pid=17730): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17730)] 08:59:09.674423 run osmo-stp_10.42.42.5(pid=17730): stdout: | (launched: 2022-12-09_08:59:08.359805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:09.802050 run osmo-stp_10.42.42.5(pid=17730): stderr: | [0;m[38;5;43m20221209085908526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085908526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085908527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085908527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085908527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085908527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085908528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:09.927816 run osmo-stp_10.42.42.5(pid=17730): stdout: | (launched: 2022-12-09_08:59:08.359805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:10.047593 run osmo-stp_10.42.42.5(pid=17730): stderr: | [0;m[38;5;43m20221209085908526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085908526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085908527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085908527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085908527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085908527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085908528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:10.190869 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17730): Process ended prematurely: osmo-stp_10.42.42.5(pid=17730) [trial-2357↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17730)] [trial-2357↪ussd:trx-umtrx↪assert_extension.py:17] 08:59:10.199284 tst assert_extension.py:17: Test FAILED (5.9 sec) 08:59:10.225772 run osmo-hlr_10.42.42.2(pid=17727): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17727)] 08:59:10.274404 run osmo-hlr_10.42.42.2(pid=17727): stdout: | (launched: 2022-12-09_08:59:07.412227) 08:59:10.324533 run osmo-hlr_10.42.42.2(pid=17727): stderr: | [0;m[1;31m20221209085907585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085907585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085907585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085907585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085907585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085907585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085907597 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085907605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085907605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085907605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:10.394345 run osmo-msc_10.42.42.6(pid=17733): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17733)] 08:59:10.442494 run osmo-msc_10.42.42.6(pid=17733): stdout: | (launched: 2022-12-09_08:59:09.321221) 08:59:10.492346 run osmo-msc_10.42.42.6(pid=17733): stderr: | [0;m[38;5;43m20221209085909591 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085909591 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2efe707c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085909591 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085909591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085909592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085909592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085909594 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085909594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085909594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085909594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:10.542706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17726): Terminating (SIGTERM) 08:59:10.583034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17729): Terminating (SIGTERM) 08:59:10.623209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17732): Terminating (SIGTERM) 08:59:10.663953 --- ParallelTerminationStrategy: PID 17726 died... 08:59:10.683221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17726): Terminated: ok {rc=0} 08:59:10.727594 --- ParallelTerminationStrategy: PID 17729 died... 08:59:10.746349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17729): Terminated: ok {rc=0} 08:59:10.790386 --- ParallelTerminationStrategy: PID 17732 died... 08:59:10.809049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17732): Terminated: ok {rc=0} 08:59:10.893580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:59:12.109239 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:12.116276 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:59:12.150782 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:59:12.179034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:59:12.233754 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:59:12.268639 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:59:12.297192 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:59:12.850746 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:59:12.904567 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:12.916528 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:59:12.991464 tst mo_mt_call.py: using LAC 20362 08:59:13.112490 tst mo_mt_call.py: using RAC 217 08:59:13.231333 tst mo_mt_call.py: using CellId 20362 08:59:13.351773 tst mo_mt_call.py: using BVCI 20363 08:59:13.463078 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:13.474475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:13.485764 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:13.496825 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:13.508034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:13.519053 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:59:13.634337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:59:13.756247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:14.269308 run create_hlr_db(pid=17738): Launched 08:59:14.395019 bus /sierra_2: Setting Powered False 08:59:15.459651 run create_hlr_db(pid=17738): Terminated: ok {rc=0} 08:59:15.911824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Launched 08:59:16.256653 run osmo-hlr_10.42.42.2(pid=17741): Launched 08:59:16.510970 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:17.172888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Launched 08:59:17.512487 run osmo-stp_10.42.42.5(pid=17744): Launched 08:59:17.639653 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:18.235283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Launched 08:59:18.565671 run osmo-msc_10.42.42.6(pid=17747): Launched 08:59:18.752118 run osmo-stp_10.42.42.5(pid=17744): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] 08:59:18.891447 run osmo-stp_10.42.42.5(pid=17744): stdout: | (launched: 2022-12-09_08:59:17.452463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:19.031056 run osmo-stp_10.42.42.5(pid=17744): stderr: | [0;m[38;5;43m20221209085917643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085917644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085917644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085917644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085917645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085917645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085917645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:19.167806 run osmo-stp_10.42.42.5(pid=17744): stdout: | (launched: 2022-12-09_08:59:17.452463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:19.299855 run osmo-stp_10.42.42.5(pid=17744): stderr: | [0;m[38;5;43m20221209085917643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085917644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085917644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085917644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085917645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085917645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085917645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:19.456846 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17744): Process ended prematurely: osmo-stp_10.42.42.5(pid=17744) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:59:19.466554 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:59:19.494553 run osmo-hlr_10.42.42.2(pid=17741): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17741)] 08:59:19.545553 run osmo-hlr_10.42.42.2(pid=17741): stdout: | (launched: 2022-12-09_08:59:16.196186) 08:59:19.598011 run osmo-hlr_10.42.42.2(pid=17741): stderr: | [0;m[1;31m20221209085916502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085916502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085916502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085916502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085916502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085916502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085916519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085916528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085916528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085916528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:19.671364 run osmo-msc_10.42.42.6(pid=17747): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17747)] 08:59:19.722174 run osmo-msc_10.42.42.6(pid=17747): stdout: | (launched: 2022-12-09_08:59:18.506054) 08:59:19.774594 run osmo-msc_10.42.42.6(pid=17747): stderr: | [0;m[38;5;43m20221209085918823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085918823 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc131d07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085918824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085918824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085918824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085918824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085918826 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085918826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085918826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085918826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:19.827305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Terminating (SIGTERM) 08:59:19.869520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Terminating (SIGTERM) 08:59:19.912124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Terminating (SIGTERM) 08:59:19.954653 --- ParallelTerminationStrategy: PID 17740 died... 08:59:19.974748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Terminated: ok {rc=0} 08:59:20.021672 --- ParallelTerminationStrategy: PID 17743 died... 08:59:20.041202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Terminated: ok {rc=0} 08:59:20.088024 --- ParallelTerminationStrategy: PID 17746 died... 08:59:20.107567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Terminated: ok {rc=0} 08:59:20.196176 bus /sierra_3: Setting Powered False 08:59:21.296222 bus /sierra_3: Setting Powered False 08:59:22.413062 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:59:23.564121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:23.576524 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:59:23.647860 tst mo_mt_call_osmux.py: using LAC 20363 08:59:23.774070 tst mo_mt_call_osmux.py: using RAC 218 08:59:23.900903 tst mo_mt_call_osmux.py: using CellId 20363 08:59:24.027217 tst mo_mt_call_osmux.py: using BVCI 20364 08:59:24.147642 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:24.159390 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:24.170899 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:24.182858 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:24.194806 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:59:24.206697 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:59:24.325381 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:59:24.445173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:24.924878 run create_hlr_db(pid=17749): Launched 08:59:25.051430 bus /sierra_2: Setting Powered False 08:59:26.112373 run create_hlr_db(pid=17749): Terminated: ok {rc=0} 08:59:26.539408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17751): Launched 08:59:26.846442 run osmo-hlr_10.42.42.2(pid=17752): Launched 08:59:26.964800 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:27.496650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17754): Launched 08:59:27.805124 run osmo-stp_10.42.42.5(pid=17755): Launched 08:59:27.922643 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:28.481180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17757): Launched 08:59:28.789236 run osmo-msc_10.42.42.6(pid=17758): Launched 08:59:28.961137 run osmo-stp_10.42.42.5(pid=17755): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17755)] 08:59:29.090296 run osmo-stp_10.42.42.5(pid=17755): stdout: | (launched: 2022-12-09_08:59:27.748910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:29.219850 run osmo-stp_10.42.42.5(pid=17755): stderr: | [0;m[38;5;43m20221209085927918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085927919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085927919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085927919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085927920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085927920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085927920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:29.348105 run osmo-stp_10.42.42.5(pid=17755): stdout: | (launched: 2022-12-09_08:59:27.748910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:29.470849 run osmo-stp_10.42.42.5(pid=17755): stderr: | [0;m[38;5;43m20221209085927918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085927919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085927919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085927919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085927920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085927920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085927920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:29.617948 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17755): Process ended prematurely: osmo-stp_10.42.42.5(pid=17755) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17755)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:59:29.627015 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:59:29.653964 run osmo-hlr_10.42.42.2(pid=17752): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17752)] 08:59:29.702398 run osmo-hlr_10.42.42.2(pid=17752): stdout: | (launched: 2022-12-09_08:59:26.790527) 08:59:29.752415 run osmo-hlr_10.42.42.2(pid=17752): stderr: | [0;m[1;31m20221209085926965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085926965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085926965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085926966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085926966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085926966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085926978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085926986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085926986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085926986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:29.822091 run osmo-msc_10.42.42.6(pid=17758): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17758)] 08:59:29.870077 run osmo-msc_10.42.42.6(pid=17758): stdout: | (launched: 2022-12-09_08:59:28.732723) 08:59:29.919530 run osmo-msc_10.42.42.6(pid=17758): stderr: | [0;m[38;5;43m20221209085929003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085929004 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f52b3730c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085929004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085929004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085929004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085929004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085929006 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085929006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085929006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085929007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:29.969952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17751): Terminating (SIGTERM) 08:59:30.010378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17754): Terminating (SIGTERM) 08:59:30.050730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17757): Terminating (SIGTERM) 08:59:30.091549 --- ParallelTerminationStrategy: PID 17751 died... 08:59:30.110840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17751): Terminated: ok {rc=0} 08:59:30.155577 --- ParallelTerminationStrategy: PID 17754 died... 08:59:30.174502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17754): Terminated: ok {rc=0} 08:59:30.219000 --- ParallelTerminationStrategy: PID 17757 died... 08:59:30.237925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17757): Terminated: ok {rc=0} 08:59:30.325611 bus /sierra_3: Setting Powered False 08:59:31.426970 bus /sierra_3: Setting Powered False 08:59:32.540863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:59:33.797556 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:33.804598 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:59:33.840609 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:59:33.869422 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:59:33.923237 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:59:33.958144 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:59:33.987085 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:59:34.540247 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:59:34.594654 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:34.606690 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:59:34.679445 tst mo_mt_call.py: using LAC 20364 08:59:34.807412 tst mo_mt_call.py: using RAC 219 08:59:34.938671 tst mo_mt_call.py: using CellId 20364 08:59:35.069667 tst mo_mt_call.py: using BVCI 20365 08:59:35.190187 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:35.202079 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:35.213914 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:35.225951 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:35.237782 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:35.249802 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:59:35.369486 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:59:35.489647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:35.999249 run create_hlr_db(pid=17763): Launched 08:59:36.123665 bus /sierra_2: Setting Powered False 08:59:37.188775 run create_hlr_db(pid=17763): Terminated: ok {rc=0} 08:59:37.627919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17765): Launched 08:59:37.935859 run osmo-hlr_10.42.42.2(pid=17766): Launched 08:59:38.054465 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:38.601648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17768): Launched 08:59:38.908853 run osmo-stp_10.42.42.5(pid=17769): Launched 08:59:39.026607 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:39.582392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17771): Launched 08:59:39.891099 run osmo-msc_10.42.42.6(pid=17772): Launched 08:59:40.064790 run osmo-stp_10.42.42.5(pid=17769): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17769)] 08:59:40.193793 run osmo-stp_10.42.42.5(pid=17769): stdout: | (launched: 2022-12-09_08:59:38.852719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:40.322808 run osmo-stp_10.42.42.5(pid=17769): stderr: | [0;m[38;5;43m20221209085939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085939022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085939022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085939022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085939022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:40.450347 run osmo-stp_10.42.42.5(pid=17769): stdout: | (launched: 2022-12-09_08:59:38.852719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:40.573104 run osmo-stp_10.42.42.5(pid=17769): stderr: | [0;m[38;5;43m20221209085939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085939021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085939022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085939022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085939022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085939022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:40.719862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17769): Process ended prematurely: osmo-stp_10.42.42.5(pid=17769) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17769)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:59:40.729206 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:59:40.755964 run osmo-hlr_10.42.42.2(pid=17766): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17766)] 08:59:40.804046 run osmo-hlr_10.42.42.2(pid=17766): stdout: | (launched: 2022-12-09_08:59:37.879914) 08:59:40.853777 run osmo-hlr_10.42.42.2(pid=17766): stderr: | [0;m[1;31m20221209085938053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085938053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085938053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085938053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085938053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085938054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085938066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085938074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085938074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085938074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:40.923065 run osmo-msc_10.42.42.6(pid=17772): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17772)] 08:59:40.970783 run osmo-msc_10.42.42.6(pid=17772): stdout: | (launched: 2022-12-09_08:59:39.834979) 08:59:41.020131 run osmo-msc_10.42.42.6(pid=17772): stderr: | [0;m[38;5;43m20221209085940105 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085940105 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f734541ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085940105 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085940105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085940105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085940106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085940107 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085940108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085940108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085940108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:41.070116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17765): Terminating (SIGTERM) 08:59:41.110002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17768): Terminating (SIGTERM) 08:59:41.149793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17771): Terminating (SIGTERM) 08:59:41.189972 --- ParallelTerminationStrategy: PID 17765 died... 08:59:41.209145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17765): Terminated: ok {rc=0} 08:59:41.253677 --- ParallelTerminationStrategy: PID 17768 died... 08:59:41.272503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17768): Terminated: ok {rc=0} 08:59:41.317251 --- ParallelTerminationStrategy: PID 17771 died... 08:59:41.336181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17771): Terminated: ok {rc=0} 08:59:41.422446 bus /sierra_3: Setting Powered False 08:59:42.522930 bus /sierra_3: Setting Powered False 08:59:43.639017 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:59:44.791630 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:44.804253 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:59:44.876176 tst mo_mt_call_osmux.py: using LAC 20365 08:59:45.007057 tst mo_mt_call_osmux.py: using RAC 220 08:59:45.135754 tst mo_mt_call_osmux.py: using CellId 20365 08:59:45.263894 tst mo_mt_call_osmux.py: using BVCI 20366 08:59:45.383715 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:45.395545 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:45.407139 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:45.419028 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:45.430992 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:59:45.442886 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:59:45.559903 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:59:45.682903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:46.176284 run create_hlr_db(pid=17774): Launched 08:59:46.337789 bus /sierra_2: Setting Powered False 08:59:47.399024 run create_hlr_db(pid=17774): Terminated: ok {rc=0} 08:59:47.847406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17776): Launched 08:59:48.175654 run osmo-hlr_10.42.42.2(pid=17777): Launched 08:59:48.302212 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:48.867518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17779): Launched 08:59:49.195107 run osmo-stp_10.42.42.5(pid=17780): Launched 08:59:49.321118 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:49.914231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17782): Launched 08:59:50.243882 run osmo-msc_10.42.42.6(pid=17783): Launched 08:59:50.429989 run osmo-stp_10.42.42.5(pid=17780): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17780)] 08:59:50.568839 run osmo-stp_10.42.42.5(pid=17780): stdout: | (launched: 2022-12-09_08:59:49.135335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:50.707844 run osmo-stp_10.42.42.5(pid=17780): stderr: | [0;m[38;5;43m20221209085949324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085949324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085949324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085949325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085949325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085949325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085949325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:50.844892 run osmo-stp_10.42.42.5(pid=17780): stdout: | (launched: 2022-12-09_08:59:49.135335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:50.976259 run osmo-stp_10.42.42.5(pid=17780): stderr: | [0;m[38;5;43m20221209085949324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209085949324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209085949324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209085949325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209085949325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209085949325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209085949325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:51.133450 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17780): Process ended prematurely: osmo-stp_10.42.42.5(pid=17780) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17780)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:59:51.143160 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:59:51.171200 run osmo-hlr_10.42.42.2(pid=17777): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17777)] 08:59:51.221306 run osmo-hlr_10.42.42.2(pid=17777): stdout: | (launched: 2022-12-09_08:59:48.115815) 08:59:51.273269 run osmo-hlr_10.42.42.2(pid=17777): stderr: | [0;m[1;31m20221209085948312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085948312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085948312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085948312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085948312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085948312 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085948325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085948334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085948334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085948334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:51.346076 run osmo-msc_10.42.42.6(pid=17783): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17783)] 08:59:51.396160 run osmo-msc_10.42.42.6(pid=17783): stdout: | (launched: 2022-12-09_08:59:50.183870) 08:59:51.448102 run osmo-msc_10.42.42.6(pid=17783): stderr: | [0;m[38;5;43m20221209085950502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209085950502 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d90fa0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209085950502 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209085950502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209085950503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209085950503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209085950504 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209085950505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209085950505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209085950505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:51.500355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17776): Terminating (SIGTERM) 08:59:51.542357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17779): Terminating (SIGTERM) 08:59:51.584238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17782): Terminating (SIGTERM) 08:59:51.626457 --- ParallelTerminationStrategy: PID 17776 died... 08:59:51.646337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17776): Terminated: ok {rc=0} 08:59:51.693012 --- ParallelTerminationStrategy: PID 17779 died... 08:59:51.712668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17779): Terminated: ok {rc=0} 08:59:51.759147 --- ParallelTerminationStrategy: PID 17782 died... 08:59:51.778743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17782): Terminated: ok {rc=0} 08:59:51.866772 bus /sierra_3: Setting Powered False 08:59:52.965625 bus /sierra_3: Setting Powered False 08:59:54.083625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:59:55.333861 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:55.340445 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:59:55.373846 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:59:55.400791 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:59:55.453733 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:59:55.487091 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:59:55.514033 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:59:56.065301 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:59:56.114524 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:59:56.125862 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:59:56.195730 tst mo_mt_call.py: using LAC 20366 08:59:56.318531 tst mo_mt_call.py: using RAC 221 08:59:56.440848 tst mo_mt_call.py: using CellId 20366 08:59:56.563381 tst mo_mt_call.py: using BVCI 20367 08:59:56.676856 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:59:56.688144 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:59:56.699234 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:59:56.710369 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:59:56.721530 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:59:56.732863 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:59:56.855521 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:59:56.977098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:57.453246 run create_hlr_db(pid=17788): Launched 08:59:57.579453 bus /sierra_2: Setting Powered False 08:59:58.639964 run create_hlr_db(pid=17788): Terminated: ok {rc=0} 08:59:59.087164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17790): Launched 08:59:59.416841 run osmo-hlr_10.42.42.2(pid=17791): Launched 08:59:59.542987 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:00.105953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17793): Launched 09:00:00.437290 run osmo-stp_10.42.42.5(pid=17794): Launched 09:00:00.564926 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:01.189716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17796): Launched 09:00:01.557527 run osmo-msc_10.42.42.6(pid=17804): Launched 09:00:01.865286 run osmo-stp_10.42.42.5(pid=17794): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17794)] 09:00:02.184357 run osmo-stp_10.42.42.5(pid=17794): stdout: | (launched: 2022-12-09_09:00:00.377743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:02.353677 run osmo-stp_10.42.42.5(pid=17794): stderr: | [0;m[38;5;43m20221209090000568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090000568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090000568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090000569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090000569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090000569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090000569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:02.511906 run osmo-stp_10.42.42.5(pid=17794): stdout: | (launched: 2022-12-09_09:00:00.377743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:02.667787 run osmo-stp_10.42.42.5(pid=17794): stderr: | [0;m[38;5;43m20221209090000568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090000568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090000568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090000569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090000569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090000569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090000569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:02.845633 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17794): Process ended prematurely: osmo-stp_10.42.42.5(pid=17794) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17794)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:00:02.857728 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 09:00:02.888666 run osmo-hlr_10.42.42.2(pid=17791): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17791)] 09:00:02.945411 run osmo-hlr_10.42.42.2(pid=17791): stdout: | (launched: 2022-12-09_08:59:59.357252) 09:00:03.003226 run osmo-hlr_10.42.42.2(pid=17791): stderr: | [0;m[1;31m20221209085959553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209085959553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209085959553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209085959553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209085959553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209085959553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209085959565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209085959574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209085959575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209085959575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:03.076261 run osmo-msc_10.42.42.6(pid=17804): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17804)] 09:00:03.127097 run osmo-msc_10.42.42.6(pid=17804): stdout: | (launched: 2022-12-09_09:00:01.485483) 09:00:03.178560 run osmo-msc_10.42.42.6(pid=17804): stderr: | [0;m[38;5;43m20221209090001976 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090001976 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff41617bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090001976 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090001976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090001977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090001977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090001978 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090001985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090001985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090001985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:00:03.229841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17790): Terminating (SIGTERM) 09:00:03.271608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17793): Terminating (SIGTERM) 09:00:03.315193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17796): Terminating (SIGTERM) 09:00:03.359563 --- ParallelTerminationStrategy: PID 17790 died... 09:00:03.378981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17790): Terminated: ok {rc=0} 09:00:03.424309 --- ParallelTerminationStrategy: PID 17793 died... 09:00:03.443658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17793): Terminated: ok {rc=0} 09:00:03.488582 --- ParallelTerminationStrategy: PID 17796 died... 09:00:03.508312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17796): Terminated: ok {rc=0} 09:00:03.599774 bus /sierra_3: Setting Powered False 09:00:04.698857 bus /sierra_3: Setting Powered False 09:00:05.815220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:00:06.965591 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:00:06.978206 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:00:07.051039 tst mo_mt_call_osmux.py: using LAC 20367 09:00:07.179618 tst mo_mt_call_osmux.py: using RAC 222 09:00:07.309783 tst mo_mt_call_osmux.py: using CellId 20367 09:00:07.439634 tst mo_mt_call_osmux.py: using BVCI 20368 09:00:07.559459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:00:07.571221 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:00:07.582858 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:00:07.594769 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:00:07.606802 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:00:07.618636 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:00:07.737590 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:00:07.861273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:08.340196 run create_hlr_db(pid=17842): Launched 09:00:08.466762 bus /sierra_2: Setting Powered False 09:00:09.529178 run create_hlr_db(pid=17842): Terminated: ok {rc=0} 09:00:09.958208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17845): Launched 09:00:10.265867 run osmo-hlr_10.42.42.2(pid=17846): Launched 09:00:10.384579 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:10.932523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17848): Launched 09:00:11.241346 run osmo-stp_10.42.42.5(pid=17849): Launched 09:00:11.359350 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:11.915153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17851): Launched 09:00:12.221923 run osmo-msc_10.42.42.6(pid=17852): Launched 09:00:12.394684 run osmo-stp_10.42.42.5(pid=17849): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17849)] 09:00:12.524305 run osmo-stp_10.42.42.5(pid=17849): stdout: | (launched: 2022-12-09_09:00:11.185087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:12.653895 run osmo-stp_10.42.42.5(pid=17849): stderr: | [0;m[38;5;43m20221209090011354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090011354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090011355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090011355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090011355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090011355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090011356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:12.781583 run osmo-stp_10.42.42.5(pid=17849): stdout: | (launched: 2022-12-09_09:00:11.185087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:12.904228 run osmo-stp_10.42.42.5(pid=17849): stderr: | [0;m[38;5;43m20221209090011354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090011354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090011355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090011355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090011355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090011355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090011356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:13.051057 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17849): Process ended prematurely: osmo-stp_10.42.42.5(pid=17849) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17849)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:00:13.060024 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:00:13.086769 run osmo-hlr_10.42.42.2(pid=17846): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17846)] 09:00:13.134993 run osmo-hlr_10.42.42.2(pid=17846): stdout: | (launched: 2022-12-09_09:00:10.209589) 09:00:13.184610 run osmo-hlr_10.42.42.2(pid=17846): stderr: | [0;m[1;31m20221209090010384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090010384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090010384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090010384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090010384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090010384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090010396 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090010404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090010405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090010405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:13.253872 run osmo-msc_10.42.42.6(pid=17852): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17852)] 09:00:13.301646 run osmo-msc_10.42.42.6(pid=17852): stdout: | (launched: 2022-12-09_09:00:12.165839) 09:00:13.350734 run osmo-msc_10.42.42.6(pid=17852): stderr: | [0;m[38;5;43m20221209090012432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090012432 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8e4fd1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090012432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090012432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090012432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090012433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090012434 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090012435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090012435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090012435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:00:13.400106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17845): Terminating (SIGTERM) 09:00:13.439406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17848): Terminating (SIGTERM) 09:00:13.479100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17851): Terminating (SIGTERM) 09:00:13.519098 --- ParallelTerminationStrategy: PID 17845 died... 09:00:13.538228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17845): Terminated: ok {rc=0} 09:00:13.582366 --- ParallelTerminationStrategy: PID 17848 died... 09:00:13.600914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17848): Terminated: ok {rc=0} 09:00:13.644701 --- ParallelTerminationStrategy: PID 17851 died... 09:00:13.663501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17851): Terminated: ok {rc=0} 09:00:13.746723 bus /sierra_3: Setting Powered False 09:00:14.843212 bus /sierra_3: Setting Powered False 09:00:15.984275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:00:17.270580 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:17.278129 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:00:17.312118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:00:17.339691 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:00:17.392142 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:00:17.425262 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:00:17.452547 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:00:18.005258 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:00:18.054228 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:18.065610 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:00:18.135457 tst mo_mt_call.py: using LAC 20368 09:00:18.266374 tst mo_mt_call.py: using RAC 223 09:00:18.396730 tst mo_mt_call.py: using CellId 20368 09:00:18.525964 tst mo_mt_call.py: using BVCI 20369 09:00:18.645540 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:18.657510 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:18.669530 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:18.681481 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:18.693663 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:18.705818 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:00:18.830329 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:00:18.955879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:19.468721 run create_hlr_db(pid=17858): Launched 09:00:19.595210 bus /sierra_2: Setting Powered False 09:00:20.659959 run create_hlr_db(pid=17858): Terminated: ok {rc=0} 09:00:21.116354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17860): Launched 09:00:21.445876 run osmo-hlr_10.42.42.2(pid=17861): Launched 09:00:21.573471 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:22.139085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17863): Launched 09:00:22.453198 run osmo-stp_10.42.42.5(pid=17864): Launched 09:00:22.571723 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:23.132477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17866): Launched 09:00:23.441969 run osmo-msc_10.42.42.6(pid=17867): Launched 09:00:23.614667 run osmo-stp_10.42.42.5(pid=17864): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17864)] 09:00:23.744567 run osmo-stp_10.42.42.5(pid=17864): stdout: | (launched: 2022-12-09_09:00:22.396715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:23.874288 run osmo-stp_10.42.42.5(pid=17864): stderr: | [0;m[38;5;43m20221209090022564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090022565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090022565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090022565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090022566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090022566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090022566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:24.002339 run osmo-stp_10.42.42.5(pid=17864): stdout: | (launched: 2022-12-09_09:00:22.396715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:24.125745 run osmo-stp_10.42.42.5(pid=17864): stderr: | [0;m[38;5;43m20221209090022564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090022565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090022565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090022565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090022566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090022566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090022566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:24.273261 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17864): Process ended prematurely: osmo-stp_10.42.42.5(pid=17864) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17864)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:00:24.282154 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:00:24.308559 run osmo-hlr_10.42.42.2(pid=17861): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17861)] 09:00:24.356777 run osmo-hlr_10.42.42.2(pid=17861): stdout: | (launched: 2022-12-09_09:00:21.386284) 09:00:24.407055 run osmo-hlr_10.42.42.2(pid=17861): stderr: | [0;m[1;31m20221209090021581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090021581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090021581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090021581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090021581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090021582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090021594 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090021603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090021603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090021603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:24.476640 run osmo-msc_10.42.42.6(pid=17867): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17867)] 09:00:24.525187 run osmo-msc_10.42.42.6(pid=17867): stdout: | (launched: 2022-12-09_09:00:23.385584) 09:00:24.575108 run osmo-msc_10.42.42.6(pid=17867): stderr: | [0;m[38;5;43m20221209090023657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090023657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc20e21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090023657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090023657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090023657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090023657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090023659 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090023659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090023660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090023660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:00:24.625355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17860): Terminating (SIGTERM) 09:00:24.665349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17863): Terminating (SIGTERM) 09:00:24.705357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17866): Terminating (SIGTERM) 09:00:24.745561 --- ParallelTerminationStrategy: PID 17860 died... 09:00:24.764672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17860): Terminated: ok {rc=0} 09:00:24.809315 --- ParallelTerminationStrategy: PID 17863 died... 09:00:24.827978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17863): Terminated: ok {rc=0} 09:00:24.872186 --- ParallelTerminationStrategy: PID 17866 died... 09:00:24.891030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17866): Terminated: ok {rc=0} 09:00:24.975410 bus /sierra_3: Setting Powered False 09:00:26.074047 bus /sierra_3: Setting Powered False 09:00:27.190721 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:00:28.340405 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:28.352879 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:00:28.425247 tst mo_mt_call_osmux.py: using LAC 20369 09:00:28.555509 tst mo_mt_call_osmux.py: using RAC 224 09:00:28.684518 tst mo_mt_call_osmux.py: using CellId 20369 09:00:28.813177 tst mo_mt_call_osmux.py: using BVCI 20370 09:00:28.925593 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:28.937323 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:28.948536 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:28.959936 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:28.971414 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:00:28.982839 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:00:29.103841 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:00:29.226702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:29.738026 run create_hlr_db(pid=17869): Launched 09:00:29.863603 bus /sierra_2: Setting Powered False 09:00:30.932228 run create_hlr_db(pid=17869): Terminated: ok {rc=0} 09:00:31.393112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17871): Launched 09:00:31.798491 run osmo-hlr_10.42.42.2(pid=17872): Launched 09:00:32.076147 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:32.725119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17874): Launched 09:00:33.054221 run osmo-stp_10.42.42.5(pid=17875): Launched 09:00:33.181986 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:33.776577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17877): Launched 09:00:34.105498 run osmo-msc_10.42.42.6(pid=17878): Launched 09:00:34.289506 run osmo-stp_10.42.42.5(pid=17875): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17875)] 09:00:34.428461 run osmo-stp_10.42.42.5(pid=17875): stdout: | (launched: 2022-12-09_09:00:32.994713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:34.567332 run osmo-stp_10.42.42.5(pid=17875): stderr: | [0;m[38;5;43m20221209090033184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090033184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090033184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090033185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090033185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090033185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090033185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:34.704354 run osmo-stp_10.42.42.5(pid=17875): stdout: | (launched: 2022-12-09_09:00:32.994713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:34.835477 run osmo-stp_10.42.42.5(pid=17875): stderr: | [0;m[38;5;43m20221209090033184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090033184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090033184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090033185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090033185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090033185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090033185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:34.992530 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17875): Process ended prematurely: osmo-stp_10.42.42.5(pid=17875) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17875)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:00:35.002049 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 09:00:35.030409 run osmo-hlr_10.42.42.2(pid=17872): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17872)] 09:00:35.080830 run osmo-hlr_10.42.42.2(pid=17872): stdout: | (launched: 2022-12-09_09:00:31.741037) 09:00:35.133140 run osmo-hlr_10.42.42.2(pid=17872): stderr: | [0;m[1;31m20221209090032129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090032129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090032129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090032129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090032129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090032129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090032158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090032185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090032185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090032186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:35.205676 run osmo-msc_10.42.42.6(pid=17878): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17878)] 09:00:35.255866 run osmo-msc_10.42.42.6(pid=17878): stdout: | (launched: 2022-12-09_09:00:34.045278) 09:00:35.308247 run osmo-msc_10.42.42.6(pid=17878): stderr: | [0;m[38;5;43m20221209090034366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090034366 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbefc896c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090034366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090034366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090034366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090034367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090034368 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090034369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090034369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090034369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:00:35.360721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17871): Terminating (SIGTERM) 09:00:35.402671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17874): Terminating (SIGTERM) 09:00:35.444641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17877): Terminating (SIGTERM) 09:00:35.487451 --- ParallelTerminationStrategy: PID 17871 died... 09:00:35.507389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17871): Terminated: ok {rc=0} 09:00:35.554068 --- ParallelTerminationStrategy: PID 17874 died... 09:00:35.573718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17874): Terminated: ok {rc=0} 09:00:35.619938 --- ParallelTerminationStrategy: PID 17877 died... 09:00:35.639447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17877): Terminated: ok {rc=0} 09:00:35.727349 bus /sierra_3: Setting Powered False 09:00:36.826492 bus /sierra_3: Setting Powered False 09:00:37.943551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:00:39.198638 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:39.205588 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:00:39.240863 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:00:39.269375 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:00:39.323397 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:00:39.357952 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:00:39.386259 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:00:39.937866 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:00:39.988881 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:40.000403 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:00:40.069426 tst mo_mt_call.py: using LAC 20370 09:00:40.192632 tst mo_mt_call.py: using RAC 225 09:00:40.314126 tst mo_mt_call.py: using CellId 20370 09:00:40.436689 tst mo_mt_call.py: using BVCI 20371 09:00:40.549371 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:40.560560 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:40.571872 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:40.583052 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:40.594337 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:40.605493 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:00:40.727269 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:00:40.848716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:41.361202 run create_hlr_db(pid=17885): Launched 09:00:41.486493 bus /sierra_2: Setting Powered False 09:00:42.551188 run create_hlr_db(pid=17885): Terminated: ok {rc=0} 09:00:42.990881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17888): Launched 09:00:43.301549 run osmo-hlr_10.42.42.2(pid=17889): Launched 09:00:43.419836 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:43.950791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17891): Launched 09:00:44.258466 run osmo-stp_10.42.42.5(pid=17892): Launched 09:00:44.376721 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:44.933384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17894): Launched 09:00:45.241430 run osmo-msc_10.42.42.6(pid=17895): Launched 09:00:45.414009 run osmo-stp_10.42.42.5(pid=17892): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17892)] 09:00:45.543199 run osmo-stp_10.42.42.5(pid=17892): stdout: | (launched: 2022-12-09_09:00:44.202386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:45.672408 run osmo-stp_10.42.42.5(pid=17892): stderr: | [0;m[38;5;43m20221209090044369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090044369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090044369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090044370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090044370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090044370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090044370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:45.800050 run osmo-stp_10.42.42.5(pid=17892): stdout: | (launched: 2022-12-09_09:00:44.202386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:45.949252 run osmo-stp_10.42.42.5(pid=17892): stderr: | [0;m[38;5;43m20221209090044369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090044369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090044369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090044370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090044370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090044370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090044370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:46.102855 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17892): Process ended prematurely: osmo-stp_10.42.42.5(pid=17892) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17892)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:00:46.112384 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:00:46.140054 run osmo-hlr_10.42.42.2(pid=17889): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17889)] 09:00:46.189294 run osmo-hlr_10.42.42.2(pid=17889): stdout: | (launched: 2022-12-09_09:00:43.244165) 09:00:46.240215 run osmo-hlr_10.42.42.2(pid=17889): stderr: | [0;m[1;31m20221209090043420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090043420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090043420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090043420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090043420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090043420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090043436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090043447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090043447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090043447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:46.310448 run osmo-msc_10.42.42.6(pid=17895): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17895)] 09:00:46.359602 run osmo-msc_10.42.42.6(pid=17895): stdout: | (launched: 2022-12-09_09:00:45.185093) 09:00:46.410070 run osmo-msc_10.42.42.6(pid=17895): stderr: | [0;m[38;5;43m20221209090045454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090045454 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7851a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090045454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090045455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090045455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090045455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090045457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090045457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090045457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090045457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:00:46.461411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17888): Terminating (SIGTERM) 09:00:46.502798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17891): Terminating (SIGTERM) 09:00:46.545783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17894): Terminating (SIGTERM) 09:00:46.589149 --- ParallelTerminationStrategy: PID 17888 died... 09:00:46.609335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17888): Terminated: ok {rc=0} 09:00:46.654324 --- ParallelTerminationStrategy: PID 17891 died... 09:00:46.674259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17891): Terminated: ok {rc=0} 09:00:46.719223 --- ParallelTerminationStrategy: PID 17894 died... 09:00:46.739031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17894): Terminated: ok {rc=0} 09:00:46.827027 bus /sierra_3: Setting Powered False 09:00:47.923460 bus /sierra_3: Setting Powered False 09:00:49.036574 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:00:50.188243 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:50.200760 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:00:50.274036 tst mo_mt_call_osmux.py: using LAC 20371 09:00:50.404702 tst mo_mt_call_osmux.py: using RAC 226 09:00:50.533138 tst mo_mt_call_osmux.py: using CellId 20371 09:00:50.655556 tst mo_mt_call_osmux.py: using BVCI 20372 09:00:50.768676 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:50.780115 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:50.791403 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:50.802646 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:50.813816 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:00:50.825105 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:00:50.946983 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:00:51.068690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:51.579441 run create_hlr_db(pid=17897): Launched 09:00:51.706108 bus /sierra_2: Setting Powered False 09:00:52.770934 run create_hlr_db(pid=17897): Terminated: ok {rc=0} 09:00:53.207989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17899): Launched 09:00:53.539376 run osmo-hlr_10.42.42.2(pid=17900): Launched 09:00:53.667726 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:54.237694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17902): Launched 09:00:54.565711 run osmo-stp_10.42.42.5(pid=17903): Launched 09:00:54.693743 run osmo-msc_10.42.42.6: Starting osmo-msc 09:00:55.288108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17905): Launched 09:00:55.617763 run osmo-msc_10.42.42.6(pid=17906): Launched 09:00:55.802257 run osmo-stp_10.42.42.5(pid=17903): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17903)] 09:00:55.939642 run osmo-stp_10.42.42.5(pid=17903): stdout: | (launched: 2022-12-09_09:00:54.506288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:56.078114 run osmo-stp_10.42.42.5(pid=17903): stderr: | [0;m[38;5;43m20221209090054695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090054695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090054695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090054696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090054696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090054696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090054696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:56.215211 run osmo-stp_10.42.42.5(pid=17903): stdout: | (launched: 2022-12-09_09:00:54.506288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:56.347064 run osmo-stp_10.42.42.5(pid=17903): stderr: | [0;m[38;5;43m20221209090054695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090054695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090054695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090054696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090054696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090054696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090054696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:56.504576 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17903): Process ended prematurely: osmo-stp_10.42.42.5(pid=17903) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17903)] [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:00:56.514253 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:00:56.542534 run osmo-hlr_10.42.42.2(pid=17900): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17900)] 09:00:56.592800 run osmo-hlr_10.42.42.2(pid=17900): stdout: | (launched: 2022-12-09_09:00:53.479730) 09:00:56.644828 run osmo-hlr_10.42.42.2(pid=17900): stderr: | [0;m[1;31m20221209090053675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090053675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090053675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090053675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090053675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090053675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090053687 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090053695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090053696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090053696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:56.717839 run osmo-msc_10.42.42.6(pid=17906): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17906)] 09:00:56.768280 run osmo-msc_10.42.42.6(pid=17906): stdout: | (launched: 2022-12-09_09:00:55.557953) 09:00:56.820104 run osmo-msc_10.42.42.6(pid=17906): stderr: | [0;m[38;5;43m20221209090055879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090055879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88f933ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090055880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090055880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090055880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090055880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090055882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090055882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090055882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090055882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:00:56.872141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17899): Terminating (SIGTERM) 09:00:56.913959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17902): Terminating (SIGTERM) 09:00:56.955765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17905): Terminating (SIGTERM) 09:00:56.998100 --- ParallelTerminationStrategy: PID 17899 died... 09:00:57.018118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17899): Terminated: ok {rc=0} 09:00:57.064843 --- ParallelTerminationStrategy: PID 17902 died... 09:00:57.084637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17902): Terminated: ok {rc=0} 09:00:57.131278 --- ParallelTerminationStrategy: PID 17905 died... 09:00:57.150735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17905): Terminated: ok {rc=0} 09:00:57.239070 bus /sierra_3: Setting Powered False 09:00:58.338551 bus /sierra_3: Setting Powered False 09:00:59.454592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:01:00.712672 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:00.719712 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:01:00.754115 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:01:00.782014 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:01:00.838572 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:01:00.874324 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:01:00.904525 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:01:01.460138 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:01:01.535314 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:01.549875 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:01:01.641926 tst mo_mt_call.py: using LAC 20372 09:01:01.813437 tst mo_mt_call.py: using RAC 227 09:01:01.936639 tst mo_mt_call.py: using CellId 20372 09:01:02.085647 tst mo_mt_call.py: using BVCI 20373 09:01:02.199493 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:02.211605 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:02.223560 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:02.235441 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:02.247351 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:02.259220 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:01:02.380479 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:01:02.502368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:03.013917 run create_hlr_db(pid=17911): Launched 09:01:03.142110 bus /sierra_2: Setting Powered False 09:01:04.206817 run create_hlr_db(pid=17911): Terminated: ok {rc=0} 09:01:04.646068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17913): Launched 09:01:04.955273 run osmo-hlr_10.42.42.2(pid=17914): Launched 09:01:05.073111 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:05.619151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17916): Launched 09:01:05.928258 run osmo-stp_10.42.42.5(pid=17917): Launched 09:01:06.046417 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:06.603992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17919): Launched 09:01:06.914082 run osmo-msc_10.42.42.6(pid=17920): Launched 09:01:07.088552 run osmo-stp_10.42.42.5(pid=17917): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17917)] 09:01:07.218168 run osmo-stp_10.42.42.5(pid=17917): stdout: | (launched: 2022-12-09_09:01:05.872110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:07.348323 run osmo-stp_10.42.42.5(pid=17917): stderr: | [0;m[38;5;43m20221209090106041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090106041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090106041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090106042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090106042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090106042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090106042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:07.476777 run osmo-stp_10.42.42.5(pid=17917): stdout: | (launched: 2022-12-09_09:01:05.872110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:07.600274 run osmo-stp_10.42.42.5(pid=17917): stderr: | [0;m[38;5;43m20221209090106041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090106041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090106041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090106042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090106042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090106042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090106042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:07.747864 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17917): Process ended prematurely: osmo-stp_10.42.42.5(pid=17917) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17917)] [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:01:07.756899 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:01:07.783801 run osmo-hlr_10.42.42.2(pid=17914): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17914)] 09:01:07.832334 run osmo-hlr_10.42.42.2(pid=17914): stdout: | (launched: 2022-12-09_09:01:04.898550) 09:01:07.882348 run osmo-hlr_10.42.42.2(pid=17914): stderr: | [0;m[1;31m20221209090105071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090105071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090105071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090105071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090105071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090105071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090105083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090105091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090105092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090105092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:07.952230 run osmo-msc_10.42.42.6(pid=17920): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17920)] 09:01:08.000349 run osmo-msc_10.42.42.6(pid=17920): stdout: | (launched: 2022-12-09_09:01:06.857584) 09:01:08.049904 run osmo-msc_10.42.42.6(pid=17920): stderr: | [0;m[38;5;43m20221209090107127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090107127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0039bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090107127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090107127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090107128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090107128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090107130 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090107130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090107130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090107130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:08.100176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17913): Terminating (SIGTERM) 09:01:08.140780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17916): Terminating (SIGTERM) 09:01:08.181368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17919): Terminating (SIGTERM) 09:01:08.222096 --- ParallelTerminationStrategy: PID 17913 died... 09:01:08.241526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17913): Terminated: ok {rc=0} 09:01:08.286388 --- ParallelTerminationStrategy: PID 17916 died... 09:01:08.305293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17916): Terminated: ok {rc=0} 09:01:08.349861 --- ParallelTerminationStrategy: PID 17919 died... 09:01:08.368916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17919): Terminated: ok {rc=0} 09:01:08.456204 bus /sierra_3: Setting Powered False 09:01:09.557258 bus /sierra_3: Setting Powered False 09:01:10.675071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:01:11.826337 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:11.839173 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:01:11.912756 tst mo_mt_call_osmux.py: using LAC 20373 09:01:12.042464 tst mo_mt_call_osmux.py: using RAC 228 09:01:12.170739 tst mo_mt_call_osmux.py: using CellId 20373 09:01:12.300458 tst mo_mt_call_osmux.py: using BVCI 20374 09:01:12.422176 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:12.434249 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:12.446161 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:12.458244 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:12.470709 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:01:12.482711 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:01:12.604907 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:01:12.727318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:13.207104 run create_hlr_db(pid=17922): Launched 09:01:13.332235 bus /sierra_2: Setting Powered False 09:01:14.393609 run create_hlr_db(pid=17922): Terminated: ok {rc=0} 09:01:14.822445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17924): Launched 09:01:15.129413 run osmo-hlr_10.42.42.2(pid=17925): Launched 09:01:15.245611 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:15.775782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17927): Launched 09:01:16.098490 run osmo-stp_10.42.42.5(pid=17928): Launched 09:01:16.296630 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:17.134614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17930): Launched 09:01:17.460845 run osmo-msc_10.42.42.6(pid=17931): Launched 09:01:17.637103 run osmo-stp_10.42.42.5(pid=17928): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17928)] 09:01:17.768593 run osmo-stp_10.42.42.5(pid=17928): stdout: | (launched: 2022-12-09_09:01:16.040134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:17.899728 run osmo-stp_10.42.42.5(pid=17928): stderr: | [0;m[38;5;43m20221209090116345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090116346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090116347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090116348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090116350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090116350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090116350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:18.029292 run osmo-stp_10.42.42.5(pid=17928): stdout: | (launched: 2022-12-09_09:01:16.040134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:18.152594 run osmo-stp_10.42.42.5(pid=17928): stderr: | [0;m[38;5;43m20221209090116345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090116346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090116347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090116348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090116350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090116350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090116350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:18.300016 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17928): Process ended prematurely: osmo-stp_10.42.42.5(pid=17928) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17928)] [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:01:18.308872 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:01:18.335897 run osmo-hlr_10.42.42.2(pid=17925): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17925)] 09:01:18.384897 run osmo-hlr_10.42.42.2(pid=17925): stdout: | (launched: 2022-12-09_09:01:15.072769) 09:01:18.434846 run osmo-hlr_10.42.42.2(pid=17925): stderr: | [0;m[1;31m20221209090115248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090115248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090115248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090115248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090115248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090115248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090115261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090115270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090115270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090115270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:18.504600 run osmo-msc_10.42.42.6(pid=17931): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17931)] 09:01:18.553135 run osmo-msc_10.42.42.6(pid=17931): stdout: | (launched: 2022-12-09_09:01:17.404600) 09:01:18.603137 run osmo-msc_10.42.42.6(pid=17931): stderr: | [0;m[38;5;43m20221209090117676 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090117676 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f31a201ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090117677 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090117677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090117677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090117677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090117679 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090117679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090117679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090117679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:18.653469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17924): Terminating (SIGTERM) 09:01:18.694197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17927): Terminating (SIGTERM) 09:01:18.734785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17930): Terminating (SIGTERM) 09:01:18.775983 --- ParallelTerminationStrategy: PID 17924 died... 09:01:18.795183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17924): Terminated: ok {rc=0} 09:01:18.840993 --- ParallelTerminationStrategy: PID 17927 died... 09:01:18.860212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17927): Terminated: ok {rc=0} 09:01:18.905491 --- ParallelTerminationStrategy: PID 17930 died... 09:01:18.924261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17930): Terminated: ok {rc=0} 09:01:19.011913 bus /sierra_3: Setting Powered False 09:01:20.111942 bus /sierra_3: Setting Powered False 09:01:21.227520 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:01:22.487223 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:22.493448 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:01:22.529221 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:01:22.557678 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:01:22.611410 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:01:22.645518 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:01:22.673828 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:01:23.225581 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:01:23.278531 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:23.290187 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:01:23.363645 tst mo_mt_call.py: using LAC 20374 09:01:23.492380 tst mo_mt_call.py: using RAC 229 09:01:23.620529 tst mo_mt_call.py: using CellId 20374 09:01:23.750595 tst mo_mt_call.py: using BVCI 20375 09:01:23.872002 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:23.883567 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:23.894970 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:23.906764 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:23.918397 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:23.930131 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:01:24.047733 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:01:24.169628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:24.683011 run create_hlr_db(pid=17936): Launched 09:01:24.808594 bus /sierra_2: Setting Powered False 09:01:25.873811 run create_hlr_db(pid=17936): Terminated: ok {rc=0} 09:01:26.310140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17938): Launched 09:01:26.619062 run osmo-hlr_10.42.42.2(pid=17939): Launched 09:01:26.741019 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:27.285306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17941): Launched 09:01:27.592507 run osmo-stp_10.42.42.5(pid=17942): Launched 09:01:27.712287 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:28.268672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17944): Launched 09:01:28.577435 run osmo-msc_10.42.42.6(pid=17945): Launched 09:01:28.749925 run osmo-stp_10.42.42.5(pid=17942): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17942)] 09:01:28.880069 run osmo-stp_10.42.42.5(pid=17942): stdout: | (launched: 2022-12-09_09:01:27.536261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:29.010801 run osmo-stp_10.42.42.5(pid=17942): stderr: | [0;m[38;5;43m20221209090127703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090127703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090127703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090127704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090127704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090127704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090127704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:29.138682 run osmo-stp_10.42.42.5(pid=17942): stdout: | (launched: 2022-12-09_09:01:27.536261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:29.261324 run osmo-stp_10.42.42.5(pid=17942): stderr: | [0;m[38;5;43m20221209090127703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090127703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090127703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090127704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090127704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090127704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090127704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:29.408612 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17942): Process ended prematurely: osmo-stp_10.42.42.5(pid=17942) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17942)] [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:01:29.417615 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:01:29.444274 run osmo-hlr_10.42.42.2(pid=17939): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17939)] 09:01:29.492492 run osmo-hlr_10.42.42.2(pid=17939): stdout: | (launched: 2022-12-09_09:01:26.562501) 09:01:29.542372 run osmo-hlr_10.42.42.2(pid=17939): stderr: | [0;m[1;31m20221209090126737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090126737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090126737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090126737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090126737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090126737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090126752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090126762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090126762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090126762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:29.612203 run osmo-msc_10.42.42.6(pid=17945): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17945)] 09:01:29.660557 run osmo-msc_10.42.42.6(pid=17945): stdout: | (launched: 2022-12-09_09:01:28.520859) 09:01:29.710396 run osmo-msc_10.42.42.6(pid=17945): stderr: | [0;m[38;5;43m20221209090128791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090128792 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04473d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090128792 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090128792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090128792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090128792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090128794 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090128794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090128794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090128795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:29.760682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17938): Terminating (SIGTERM) 09:01:29.801550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17941): Terminating (SIGTERM) 09:01:29.841642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17944): Terminating (SIGTERM) 09:01:29.882021 --- ParallelTerminationStrategy: PID 17938 died... 09:01:29.901324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17938): Terminated: ok {rc=0} 09:01:29.945835 --- ParallelTerminationStrategy: PID 17941 died... 09:01:29.964794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17941): Terminated: ok {rc=0} 09:01:30.009262 --- ParallelTerminationStrategy: PID 17944 died... 09:01:30.028306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17944): Terminated: ok {rc=0} 09:01:30.114885 bus /sierra_3: Setting Powered False 09:01:31.219729 bus /sierra_3: Setting Powered False 09:01:32.341778 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:01:33.489201 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:33.500939 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:01:33.572362 tst mo_mt_call_osmux.py: using LAC 20375 09:01:33.694962 tst mo_mt_call_osmux.py: using RAC 230 09:01:33.817851 tst mo_mt_call_osmux.py: using CellId 20375 09:01:33.940606 tst mo_mt_call_osmux.py: using BVCI 20376 09:01:34.052218 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:34.063408 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:34.074371 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:34.085382 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:34.096294 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:01:34.107348 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:01:34.224409 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:01:34.346634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:34.859678 run create_hlr_db(pid=17947): Launched 09:01:34.986496 bus /sierra_2: Setting Powered False 09:01:36.050472 run create_hlr_db(pid=17947): Terminated: ok {rc=0} 09:01:36.489665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17949): Launched 09:01:36.797467 run osmo-hlr_10.42.42.2(pid=17950): Launched 09:01:36.915406 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:37.457699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17952): Launched 09:01:37.765651 run osmo-stp_10.42.42.5(pid=17953): Launched 09:01:37.882981 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:38.443992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17955): Launched 09:01:38.752311 run osmo-msc_10.42.42.6(pid=17956): Launched 09:01:38.925189 run osmo-stp_10.42.42.5(pid=17953): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17953)] 09:01:39.055357 run osmo-stp_10.42.42.5(pid=17953): stdout: | (launched: 2022-12-09_09:01:37.709304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:39.185299 run osmo-stp_10.42.42.5(pid=17953): stderr: | [0;m[38;5;43m20221209090137876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090137876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090137876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090137877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090137877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090137877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090137877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:39.313297 run osmo-stp_10.42.42.5(pid=17953): stdout: | (launched: 2022-12-09_09:01:37.709304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:39.436222 run osmo-stp_10.42.42.5(pid=17953): stderr: | [0;m[38;5;43m20221209090137876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090137876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090137876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090137877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090137877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090137877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090137877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:39.583261 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17953): Process ended prematurely: osmo-stp_10.42.42.5(pid=17953) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17953)] [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:01:39.592015 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:01:39.618858 run osmo-hlr_10.42.42.2(pid=17950): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17950)] 09:01:39.666747 run osmo-hlr_10.42.42.2(pid=17950): stdout: | (launched: 2022-12-09_09:01:36.741163) 09:01:39.716161 run osmo-hlr_10.42.42.2(pid=17950): stderr: | [0;m[1;31m20221209090136914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090136914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090136914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090136914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090136914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090136914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090136925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090136934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090136934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090136935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:39.785314 run osmo-msc_10.42.42.6(pid=17956): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17956)] 09:01:39.833439 run osmo-msc_10.42.42.6(pid=17956): stdout: | (launched: 2022-12-09_09:01:38.695871) 09:01:39.882874 run osmo-msc_10.42.42.6(pid=17956): stderr: | [0;m[38;5;43m20221209090138967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090138967 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f97d92bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090138967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090138967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090138967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090138968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090138969 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090138970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090138970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090138970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:39.932701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17949): Terminating (SIGTERM) 09:01:39.972609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17952): Terminating (SIGTERM) 09:01:40.012173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17955): Terminating (SIGTERM) 09:01:40.052009 --- ParallelTerminationStrategy: PID 17949 died... 09:01:40.071307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17949): Terminated: ok {rc=0} 09:01:40.115436 --- ParallelTerminationStrategy: PID 17952 died... 09:01:40.134125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17952): Terminated: ok {rc=0} 09:01:40.178117 --- ParallelTerminationStrategy: PID 17955 died... 09:01:40.196881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17955): Terminated: ok {rc=0} 09:01:40.283311 bus /sierra_3: Setting Powered False 09:01:41.383859 bus /sierra_3: Setting Powered False 09:01:42.498430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:01:43.748233 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:43.754064 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:01:43.787210 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 09:01:43.814226 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 09:01:43.868048 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:01:43.902630 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 09:01:43.930597 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 09:01:44.480746 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 09:01:44.529850 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:44.541444 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:01:44.594150 tst mo_mt_call.py: using LAC 20376 09:01:44.717140 tst mo_mt_call.py: using RAC 231 09:01:44.839321 tst mo_mt_call.py: using CellId 20376 09:01:44.961365 tst mo_mt_call.py: using BVCI 20377 09:01:45.073326 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:45.084821 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:45.096174 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:45.107432 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:45.118764 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:45.130326 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:01:45.248378 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:01:45.365684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:45.858115 run create_hlr_db(pid=17961): Launched 09:01:46.018787 bus /sierra_2: Setting Powered False 09:01:47.096866 run create_hlr_db(pid=17961): Terminated: ok {rc=0} 09:01:47.549174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17963): Launched 09:01:47.855976 run osmo-hlr_10.42.42.2(pid=17964): Launched 09:01:47.973555 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:48.512832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17966): Launched 09:01:48.820022 run osmo-stp_10.42.42.5(pid=17967): Launched 09:01:48.937928 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:49.493028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17969): Launched 09:01:49.799451 run osmo-msc_10.42.42.6(pid=17970): Launched 09:01:49.971680 run osmo-stp_10.42.42.5(pid=17967): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17967)] 09:01:50.101142 run osmo-stp_10.42.42.5(pid=17967): stdout: | (launched: 2022-12-09_09:01:48.763465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:50.230451 run osmo-stp_10.42.42.5(pid=17967): stderr: | [0;m[38;5;43m20221209090148931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090148931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090148931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090148932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090148932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090148932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090148932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:50.357830 run osmo-stp_10.42.42.5(pid=17967): stdout: | (launched: 2022-12-09_09:01:48.763465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:50.479763 run osmo-stp_10.42.42.5(pid=17967): stderr: | [0;m[38;5;43m20221209090148931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090148931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090148931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090148932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090148932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090148932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090148932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:50.625772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17967): Process ended prematurely: osmo-stp_10.42.42.5(pid=17967) [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17967)] [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 09:01:50.634588 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:01:50.660762 run osmo-hlr_10.42.42.2(pid=17964): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17964)] 09:01:50.708386 run osmo-hlr_10.42.42.2(pid=17964): stdout: | (launched: 2022-12-09_09:01:47.799751) 09:01:50.757477 run osmo-hlr_10.42.42.2(pid=17964): stderr: | [0;m[1;31m20221209090147975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090147975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090147975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090147975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090147975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090147975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090147988 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090147998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090147998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090147998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:50.826395 run osmo-msc_10.42.42.6(pid=17970): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17970)] 09:01:50.873797 run osmo-msc_10.42.42.6(pid=17970): stdout: | (launched: 2022-12-09_09:01:49.743213) 09:01:50.922850 run osmo-msc_10.42.42.6(pid=17970): stderr: | [0;m[38;5;43m20221209090150012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090150012 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b7a758c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090150012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090150012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090150013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090150013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090150014 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090150015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090150015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090150015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:01:50.972081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17963): Terminating (SIGTERM) 09:01:51.011541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17966): Terminating (SIGTERM) 09:01:51.051082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17969): Terminating (SIGTERM) 09:01:51.091406 --- ParallelTerminationStrategy: PID 17963 died... 09:01:51.110715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17963): Terminated: ok {rc=0} 09:01:51.155265 --- ParallelTerminationStrategy: PID 17966 died... 09:01:51.173946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17966): Terminated: ok {rc=0} 09:01:51.217647 --- ParallelTerminationStrategy: PID 17969 died... 09:01:51.236207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17969): Terminated: ok {rc=0} 09:01:51.320082 bus /sierra_3: Setting Powered False 09:01:52.416020 bus /sierra_3: Setting Powered False 09:01:53.530530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 09:01:54.680396 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:54.693449 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:01:54.751178 tst mo_mt_call_osmux.py: using LAC 20377 09:01:54.885401 tst mo_mt_call_osmux.py: using RAC 232 09:01:55.015019 tst mo_mt_call_osmux.py: using CellId 20377 09:01:55.142550 tst mo_mt_call_osmux.py: using BVCI 20378 09:01:55.262179 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:55.274249 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:55.286029 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:55.298086 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:55.310280 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:01:55.322337 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:01:55.442282 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:01:55.564718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:56.076129 run create_hlr_db(pid=17972): Launched 09:01:56.201646 bus /sierra_2: Setting Powered False 09:01:57.266254 run create_hlr_db(pid=17972): Terminated: ok {rc=0} 09:01:57.724459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17974): Launched 09:01:58.054009 run osmo-hlr_10.42.42.2(pid=17975): Launched 09:01:58.182151 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:58.753718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17977): Launched 09:01:59.083525 run osmo-stp_10.42.42.5(pid=17978): Launched 09:01:59.211945 run osmo-msc_10.42.42.6: Starting osmo-msc 09:01:59.810626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17980): Launched 09:02:00.142513 run osmo-msc_10.42.42.6(pid=17981): Launched 09:02:00.329894 run osmo-stp_10.42.42.5(pid=17978): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17978)] 09:02:00.470705 run osmo-stp_10.42.42.5(pid=17978): stdout: | (launched: 2022-12-09_09:01:59.023492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:00.611547 run osmo-stp_10.42.42.5(pid=17978): stderr: | [0;m[38;5;43m20221209090159215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090159215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090159215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090159216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090159216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090159216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090159216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:00.749922 run osmo-stp_10.42.42.5(pid=17978): stdout: | (launched: 2022-12-09_09:01:59.023492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:00.901913 run osmo-stp_10.42.42.5(pid=17978): stderr: | [0;m[38;5;43m20221209090159215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090159215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090159215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090159216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090159216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090159216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090159216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:01.063677 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17978): Process ended prematurely: osmo-stp_10.42.42.5(pid=17978) [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17978)] [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 09:02:01.074455 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:02:01.105664 run osmo-hlr_10.42.42.2(pid=17975): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17975)] 09:02:01.158449 run osmo-hlr_10.42.42.2(pid=17975): stdout: | (launched: 2022-12-09_09:01:57.994086) 09:02:01.212904 run osmo-hlr_10.42.42.2(pid=17975): stderr: | [0;m[1;31m20221209090158191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090158191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090158191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090158191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090158191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090158191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090158216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090158226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090158226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090158226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:01.288231 run osmo-msc_10.42.42.6(pid=17981): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17981)] 09:02:01.341094 run osmo-msc_10.42.42.6(pid=17981): stdout: | (launched: 2022-12-09_09:02:00.082483) 09:02:01.395806 run osmo-msc_10.42.42.6(pid=17981): stderr: | [0;m[38;5;43m20221209090200401 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090200401 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c6a1cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090200401 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090200401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090200401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090200401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090200403 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090200403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090200404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090200404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:01.450982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17974): Terminating (SIGTERM) 09:02:01.495934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17977): Terminating (SIGTERM) 09:02:01.542043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17980): Terminating (SIGTERM) 09:02:01.586973 --- ParallelTerminationStrategy: PID 17974 died... 09:02:01.607919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17974): Terminated: ok {rc=0} 09:02:01.659076 --- ParallelTerminationStrategy: PID 17977 died... 09:02:01.679825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17977): Terminated: ok {rc=0} 09:02:01.729594 --- ParallelTerminationStrategy: PID 17980 died... 09:02:01.750350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17980): Terminated: ok {rc=0} 09:02:01.842250 bus /sierra_3: Setting Powered False 09:02:02.940143 bus /sierra_3: Setting Powered False 09:02:04.055044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:trx-umtrx --------------------------------------------------------------------- 09:02:05.308693 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:05.313071 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:02:05.346005 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:02:05.373007 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 09:02:05.458396 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:02:05.491315 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:02:05.518376 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 09:02:06.104210 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 09:02:06.109185 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:06.119911 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 09:02:06.170354 tst emergency_mo_mt_call.py: using LAC 20378 09:02:06.289632 tst emergency_mo_mt_call.py: using RAC 233 09:02:06.408234 tst emergency_mo_mt_call.py: using CellId 20378 09:02:06.527909 tst emergency_mo_mt_call.py: using BVCI 20379 09:02:06.638489 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:06.649317 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:06.659837 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:06.670537 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:06.681146 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:06.691644 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:06.809965 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:06.934451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:07.406213 run create_hlr_db(pid=17986): Launched 09:02:07.532110 bus /sierra_2: Setting Powered False 09:02:08.592022 run create_hlr_db(pid=17986): Terminated: ok {rc=0} 09:02:09.035450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17988): Launched 09:02:09.360851 run osmo-hlr_10.42.42.2(pid=17989): Launched 09:02:09.485792 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:10.044195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17991): Launched 09:02:10.370220 run osmo-stp_10.42.42.5(pid=17992): Launched 09:02:10.503743 tst emergency_mo_mt_call.py: using MSISDN 7125 09:02:10.670617 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:11.254912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17994): Launched 09:02:11.582372 run osmo-msc_10.42.42.6(pid=17995): Launched 09:02:11.764151 run osmo-stp_10.42.42.5(pid=17992): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17992)] 09:02:11.902140 run osmo-stp_10.42.42.5(pid=17992): stdout: | (launched: 2022-12-09_09:02:10.309775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:12.039740 run osmo-stp_10.42.42.5(pid=17992): stderr: | [0;m[38;5;43m20221209090210499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090210499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090210500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090210500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090210501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090210502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090210502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:12.175675 run osmo-stp_10.42.42.5(pid=17992): stdout: | (launched: 2022-12-09_09:02:10.309775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:12.305162 run osmo-stp_10.42.42.5(pid=17992): stderr: | [0;m[38;5;43m20221209090210499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090210499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090210500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090210500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090210501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090210502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090210502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:12.460538 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17992): Process ended prematurely: osmo-stp_10.42.42.5(pid=17992) [trial-2357↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17992)] [trial-2357↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 09:02:12.469562 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 09:02:12.497633 run osmo-hlr_10.42.42.2(pid=17989): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17989)] 09:02:12.548073 run osmo-hlr_10.42.42.2(pid=17989): stdout: | (launched: 2022-12-09_09:02:09.300864) 09:02:12.600188 run osmo-hlr_10.42.42.2(pid=17989): stderr: | [0;m[1;31m20221209090209495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090209495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090209495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090209495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090209495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090209495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090209507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090209515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090209515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090209515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:12.672911 run osmo-msc_10.42.42.6(pid=17995): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17995)] 09:02:12.723373 run osmo-msc_10.42.42.6(pid=17995): stdout: | (launched: 2022-12-09_09:02:11.522745) 09:02:12.775557 run osmo-msc_10.42.42.6(pid=17995): stderr: | [0;m[38;5;43m20221209090211843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090211843 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcd6c87ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090211843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090211843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090211843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090211844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090211845 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090211846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090211846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090211846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:12.828162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17988): Terminating (SIGTERM) 09:02:12.870087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17991): Terminating (SIGTERM) 09:02:12.912126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17994): Terminating (SIGTERM) 09:02:12.954683 --- ParallelTerminationStrategy: PID 17988 died... 09:02:12.974781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17988): Terminated: ok {rc=0} 09:02:13.021670 --- ParallelTerminationStrategy: PID 17991 died... 09:02:13.041348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17991): Terminated: ok {rc=0} 09:02:13.087953 --- ParallelTerminationStrategy: PID 17994 died... 09:02:13.107647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17994): Terminated: ok {rc=0} 09:02:13.197253 bus /sierra_3: Setting Powered False 09:02:14.295986 bus /sierra_3: Setting Powered False 09:02:15.413561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 09:02:16.500167 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:16.516062 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 09:02:16.583034 tst emergency_preemptive_call.py: using LAC 20379 09:02:16.755100 tst emergency_preemptive_call.py: using RAC 234 09:02:16.917396 tst emergency_preemptive_call.py: using CellId 20379 09:02:17.070164 tst emergency_preemptive_call.py: using BVCI 20380 09:02:17.192711 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:17.204427 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:17.215972 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:17.227419 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:17.238979 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 09:02:17.250579 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:17.373628 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:17.492382 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:17.612575 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:17.730653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:18.203419 run create_hlr_db(pid=17997): Launched 09:02:18.328686 bus /sierra_2: Setting Powered False 09:02:19.393048 run create_hlr_db(pid=17997): Terminated: ok {rc=0} 09:02:19.846741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17999): Launched 09:02:20.173266 run osmo-hlr_10.42.42.2(pid=18000): Launched 09:02:20.299454 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:20.861724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18002): Launched 09:02:21.187350 run osmo-stp_10.42.42.5(pid=18003): Launched 09:02:21.322541 tst emergency_preemptive_call.py: using MSISDN 7126 09:02:21.493823 run osmo-msc_10.42.42.6: Starting osmo-msc 09:02:22.077341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18005): Launched 09:02:22.404446 run osmo-msc_10.42.42.6(pid=18006): Launched 09:02:22.587169 run osmo-stp_10.42.42.5(pid=18003): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18003)] 09:02:22.726425 run osmo-stp_10.42.42.5(pid=18003): stdout: | (launched: 2022-12-09_09:02:21.128028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:22.865397 run osmo-stp_10.42.42.5(pid=18003): stderr: | [0;m[38;5;43m20221209090221317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090221317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090221317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090221318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090221318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090221318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090221318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:23.001787 run osmo-stp_10.42.42.5(pid=18003): stdout: | (launched: 2022-12-09_09:02:21.128028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:23.131635 run osmo-stp_10.42.42.5(pid=18003): stderr: | [0;m[38;5;43m20221209090221317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090221317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090221317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090221318 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090221318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090221318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090221318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:23.286482 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18003): Process ended prematurely: osmo-stp_10.42.42.5(pid=18003) [trial-2357↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18003)] [trial-2357↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 09:02:23.295744 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 09:02:23.324262 run osmo-hlr_10.42.42.2(pid=18000): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18000)] 09:02:23.375686 run osmo-hlr_10.42.42.2(pid=18000): stdout: | (launched: 2022-12-09_09:02:20.113831) 09:02:23.428176 run osmo-hlr_10.42.42.2(pid=18000): stderr: | [0;m[1;31m20221209090220309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090220309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090220309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090220309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090220309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090220309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090220322 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090220331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090220331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090220331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:23.501450 run osmo-msc_10.42.42.6(pid=18006): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18006)] 09:02:23.551970 run osmo-msc_10.42.42.6(pid=18006): stdout: | (launched: 2022-12-09_09:02:22.344397) 09:02:23.604346 run osmo-msc_10.42.42.6(pid=18006): stderr: | [0;m[38;5;43m20221209090222662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090222662 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc9e03ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090222662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090222662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090222662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090222663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090222664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090222665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090222665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090222665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:02:23.657120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17999): Terminating (SIGTERM) 09:02:23.699198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18002): Terminating (SIGTERM) 09:02:23.741569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18005): Terminating (SIGTERM) 09:02:23.784556 --- ParallelTerminationStrategy: PID 17999 died... 09:02:23.805055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17999): Terminated: ok {rc=0} 09:02:23.852462 --- ParallelTerminationStrategy: PID 18002 died... 09:02:23.872627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18002): Terminated: ok {rc=0} 09:02:23.919576 --- ParallelTerminationStrategy: PID 18005 died... 09:02:23.939415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18005): Terminated: ok {rc=0} 09:02:24.028398 bus /sierra_9: Setting Powered False 09:02:25.126891 bus /sierra_9: Setting Powered False 09:02:26.242389 bus /sierra_8: Setting Powered False 09:02:27.340899 bus /sierra_8: Setting Powered False 09:02:28.457852 bus /sierra_3: Setting Powered False 09:02:29.555078 bus /sierra_3: Setting Powered False 09:02:30.673906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx --------------------------------------------------------------------- 09:02:31.960701 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:31.965062 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:02:31.999841 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 09:02:32.040113 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 09:02:32.128998 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:02:32.163429 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 09:02:32.203465 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 09:02:32.798875 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 09:02:32.854797 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:32.866244 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:02:32.916696 tst cs_paging_gprs_active.py: using LAC 20380 09:02:33.037974 tst cs_paging_gprs_active.py: using RAC 235 09:02:33.157243 tst cs_paging_gprs_active.py: using CellId 20380 09:02:33.277055 tst cs_paging_gprs_active.py: using BVCI 20381 09:02:33.389293 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.400192 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.411055 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.422116 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.432748 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.443420 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.454187 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.464666 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:33.475343 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:33.596187 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:33.719456 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:02:33.944909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:34.277543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18011): Launched 09:02:34.566479 run iperf3-srv_10.42.42.10(pid=18012): Launched 09:02:34.690796 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:02:34.915537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:35.248064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18013): Launched 09:02:35.537047 run iperf3-srv_10.42.42.10(pid=18014): Launched 09:02:35.660709 tst cs_paging_gprs_active.py:38: start network... 09:02:35.887128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:36.402573 run create_hlr_db(pid=18018): Launched 09:02:36.530219 bus /sierra_2: Setting Powered False 09:02:37.596376 run create_hlr_db(pid=18018): Terminated: ok {rc=0} 09:02:38.055272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18020): Launched 09:02:38.388757 run osmo-hlr_10.42.42.2(pid=18021): Launched 09:02:38.515734 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:39.089479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18023): Launched 09:02:39.420080 run osmo-stp_10.42.42.5(pid=18024): Launched 09:02:39.547184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:02:40.119153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18026): Launched 09:02:40.247223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:02:40.526995 run patchelf(pid=18027): Launched 09:02:40.711683 run osmo-stp_10.42.42.5(pid=18024): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18024)] 09:02:40.851555 run osmo-stp_10.42.42.5(pid=18024): stdout: | (launched: 2022-12-09_09:02:39.359417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:40.992610 run osmo-stp_10.42.42.5(pid=18024): stderr: | [0;m[38;5;43m20221209090239550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090239551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090239551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090239551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090239552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090239552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090239552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:41.133837 run osmo-stp_10.42.42.5(pid=18024): stdout: | (launched: 2022-12-09_09:02:39.359417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:41.269327 run osmo-stp_10.42.42.5(pid=18024): stderr: | [0;m[38;5;43m20221209090239550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090239551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090239551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090239551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090239552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090239552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090239552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:41.430700 run patchelf(pid=18027): Terminating (SIGINT) 09:02:41.615925 run patchelf(pid=18027): Terminated: ok {rc=0} 09:02:41.749353 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18024): Process ended prematurely: osmo-stp_10.42.42.5(pid=18024) [trial-2357↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18024)] [trial-2357↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 09:02:41.759462 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 09:02:41.788788 run osmo-hlr_10.42.42.2(pid=18021): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18021)] 09:02:41.839340 run osmo-hlr_10.42.42.2(pid=18021): stdout: | (launched: 2022-12-09_09:02:38.327986) 09:02:41.891881 run osmo-hlr_10.42.42.2(pid=18021): stderr: | [0;m[1;31m20221209090238521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090238521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090238521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090238522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090238522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090238522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090238534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090238543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090238543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090238543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:41.944342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18011): Terminating (SIGTERM) 09:02:41.986776 run iperf3-srv_10.42.42.10(pid=18012): Terminating (SIGTERM) 09:02:42.028895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18013): Terminating (SIGTERM) 09:02:42.070908 run iperf3-srv_10.42.42.10(pid=18014): Terminating (SIGTERM) 09:02:42.112643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18020): Terminating (SIGTERM) 09:02:42.155086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18023): Terminating (SIGTERM) 09:02:42.197095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18026): Terminating (SIGTERM) 09:02:42.239728 --- ParallelTerminationStrategy: PID 18011 died... 09:02:42.259919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18011): Terminated: ok {rc=0} 09:02:42.306690 --- ParallelTerminationStrategy: PID 18012 died... 09:02:42.326231 run iperf3-srv_10.42.42.10(pid=18012): Terminated {rc=256} 09:02:42.372670 --- ParallelTerminationStrategy: PID 18013 died... 09:02:42.392122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18013): Terminated: ok {rc=0} 09:02:42.438756 --- ParallelTerminationStrategy: PID 18014 died... 09:02:42.458264 run iperf3-srv_10.42.42.10(pid=18014): Terminated {rc=256} 09:02:42.504648 --- ParallelTerminationStrategy: PID 18020 died... 09:02:42.524203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18020): Terminated: ok {rc=0} 09:02:42.571214 --- ParallelTerminationStrategy: PID 18023 died... 09:02:42.590834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18023): Terminated: ok {rc=0} 09:02:42.637604 --- ParallelTerminationStrategy: PID 18026 died... 09:02:42.657322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18026): Terminated: ok {rc=0} 09:02:42.747499 bus /gobi_0: Setting Powered False 09:02:43.847164 bus /gobi_0: Setting Powered False 09:02:44.963783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx iperf3.py ---------------------------------------------- 09:02:46.129585 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.142916 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:02:46.194161 tst iperf3.py: using LAC 20381 09:02:46.345258 tst iperf3.py: using RAC 236 09:02:46.475206 tst iperf3.py: using CellId 20381 09:02:46.633739 tst iperf3.py: using BVCI 20382 09:02:46.780778 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.793667 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.806373 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.820117 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.834299 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.847731 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.860411 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.874039 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:46.888684 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:47.012651 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:02:47.243233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:47.578221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18028): Launched 09:02:47.866959 run iperf3-srv_10.42.42.10(pid=18029): Launched 09:02:47.993303 tst iperf3.py:8: start network... 09:02:48.218063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:48.733454 run create_hlr_db(pid=18030): Launched 09:02:48.860733 bus /gobi_6: Setting Powered False 09:02:49.922052 run create_hlr_db(pid=18030): Terminated: ok {rc=0} 09:02:50.372898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18032): Launched 09:02:50.705733 run osmo-hlr_10.42.42.2(pid=18033): Launched 09:02:50.829325 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:51.363578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18035): Launched 09:02:51.675334 run osmo-stp_10.42.42.5(pid=18036): Launched 09:02:51.792443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:02:52.325231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18038): Launched 09:02:52.443038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:02:52.710241 run patchelf(pid=18039): Launched 09:02:52.894094 run osmo-stp_10.42.42.5(pid=18036): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18036)] 09:02:53.034101 run osmo-stp_10.42.42.5(pid=18036): stdout: | (launched: 2022-12-09_09:02:51.618791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:53.175920 run osmo-stp_10.42.42.5(pid=18036): stderr: | [0;m[38;5;43m20221209090251788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090251788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090251788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090251789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:53.317438 run osmo-stp_10.42.42.5(pid=18036): stdout: | (launched: 2022-12-09_09:02:51.618791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:53.453628 run osmo-stp_10.42.42.5(pid=18036): stderr: | [0;m[38;5;43m20221209090251788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090251788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090251788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090251789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:53.614854 run patchelf(pid=18039): Terminating (SIGINT) 09:02:53.800358 run patchelf(pid=18039): Terminated: ok {rc=0} 09:02:53.933966 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18036): Process ended prematurely: osmo-stp_10.42.42.5(pid=18036) [trial-2357↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18036)] [trial-2357↪gprs:trx-umtrx↪iperf3.py:8] 09:02:53.944264 tst iperf3.py:8: Test FAILED (7.9 sec) 09:02:53.973585 run osmo-hlr_10.42.42.2(pid=18033): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18033)] 09:02:54.024344 run osmo-hlr_10.42.42.2(pid=18033): stdout: | (launched: 2022-12-09_09:02:50.644859) 09:02:54.076660 run osmo-hlr_10.42.42.2(pid=18033): stderr: | [0;m[1;31m20221209090250821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090250821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090250821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090250821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090250821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090250822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090250835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090250844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090250844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090250844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:54.129421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18028): Terminating (SIGTERM) 09:02:54.171588 run iperf3-srv_10.42.42.10(pid=18029): Terminating (SIGTERM) 09:02:54.214012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18032): Terminating (SIGTERM) 09:02:54.256689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18035): Terminating (SIGTERM) 09:02:54.299159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18038): Terminating (SIGTERM) 09:02:54.342015 --- ParallelTerminationStrategy: PID 18028 died... 09:02:54.362152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18028): Terminated: ok {rc=0} 09:02:54.409613 --- ParallelTerminationStrategy: PID 18029 died... 09:02:54.429617 run iperf3-srv_10.42.42.10(pid=18029): Terminated {rc=256} 09:02:54.476373 --- ParallelTerminationStrategy: PID 18032 died... 09:02:54.496348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18032): Terminated: ok {rc=0} 09:02:54.543175 --- ParallelTerminationStrategy: PID 18035 died... 09:02:54.563065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18035): Terminated: ok {rc=0} 09:02:54.609803 --- ParallelTerminationStrategy: PID 18038 died... 09:02:54.629630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18038): Terminated: ok {rc=0} 09:02:54.718494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 09:02:55.874046 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:55.885998 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:02:55.935417 tst iperf3m4.py: using LAC 20382 09:02:56.066437 tst iperf3m4.py: using RAC 237 09:02:56.196525 tst iperf3m4.py: using CellId 20382 09:02:56.330570 tst iperf3m4.py: using BVCI 20383 09:02:56.453726 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.465036 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.476128 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.487369 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.498635 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.509837 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.521228 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.532572 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:02:56.544417 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:56.667559 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:56.792301 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:56.915191 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:02:57.035688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:02:57.244597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:57.555388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18040): Launched 09:02:57.825455 run iperf3-srv_10.42.42.10(pid=18041): Launched 09:02:57.941431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:02:58.149604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:58.460199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18042): Launched 09:02:58.728879 run iperf3-srv_10.42.42.10(pid=18043): Launched 09:02:58.844784 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:02:59.052004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:59.361946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18044): Launched 09:02:59.631645 run iperf3-srv_10.42.42.10(pid=18045): Launched 09:02:59.747926 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:02:59.955640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:00.266030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18046): Launched 09:03:00.535173 run iperf3-srv_10.42.42.10(pid=18047): Launched 09:03:00.650733 tst iperf3m4.py:8: start network... 09:03:00.861614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:01.409854 run create_hlr_db(pid=18049): Launched 09:03:01.571781 bus /gobi_6: Setting Powered False 09:03:02.633855 run create_hlr_db(pid=18049): Terminated: ok {rc=0} 09:03:03.070022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18051): Launched 09:03:03.380419 run osmo-hlr_10.42.42.2(pid=18052): Launched 09:03:03.497918 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:04.032643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18054): Launched 09:03:04.343057 run osmo-stp_10.42.42.5(pid=18055): Launched 09:03:04.461610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:04.993505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18057): Launched 09:03:05.111076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:05.371715 run patchelf(pid=18058): Launched 09:03:05.542842 run osmo-stp_10.42.42.5(pid=18055): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18055)] 09:03:05.672848 run osmo-stp_10.42.42.5(pid=18055): stdout: | (launched: 2022-12-09_09:03:04.286267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:05.805610 run osmo-stp_10.42.42.5(pid=18055): stderr: | [0;m[38;5;43m20221209090304453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090304453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090304453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090304454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090304454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090304454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090304454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:05.937608 run osmo-stp_10.42.42.5(pid=18055): stdout: | (launched: 2022-12-09_09:03:04.286267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:06.064750 run osmo-stp_10.42.42.5(pid=18055): stderr: | [0;m[38;5;43m20221209090304453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090304453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090304453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090304454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090304454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090304454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090304454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:06.214880 run patchelf(pid=18058): Terminating (SIGINT) 09:03:06.387661 run patchelf(pid=18058): Terminated: ok {rc=0} 09:03:06.511939 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18055): Process ended prematurely: osmo-stp_10.42.42.5(pid=18055) [trial-2357↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18055)] [trial-2357↪gprs:trx-umtrx↪iperf3m4.py:8] 09:03:06.521656 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:03:06.548742 run osmo-hlr_10.42.42.2(pid=18052): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18052)] 09:03:06.596178 run osmo-hlr_10.42.42.2(pid=18052): stdout: | (launched: 2022-12-09_09:03:03.323682) 09:03:06.645305 run osmo-hlr_10.42.42.2(pid=18052): stderr: | [0;m[1;31m20221209090303497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090303497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090303497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090303497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090303497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090303497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090303512 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090303523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090303523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090303523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:06.694638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18040): Terminating (SIGTERM) 09:03:06.734058 run iperf3-srv_10.42.42.10(pid=18041): Terminating (SIGTERM) 09:03:06.773577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18042): Terminating (SIGTERM) 09:03:06.813186 run iperf3-srv_10.42.42.10(pid=18043): Terminating (SIGTERM) 09:03:06.852694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18044): Terminating (SIGTERM) 09:03:06.892221 run iperf3-srv_10.42.42.10(pid=18045): Terminating (SIGTERM) 09:03:06.931583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18046): Terminating (SIGTERM) 09:03:06.971173 run iperf3-srv_10.42.42.10(pid=18047): Terminating (SIGTERM) 09:03:07.010375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18051): Terminating (SIGTERM) 09:03:07.050191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18054): Terminating (SIGTERM) 09:03:07.089633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18057): Terminating (SIGTERM) 09:03:07.129488 --- ParallelTerminationStrategy: PID 18040 died... 09:03:07.148322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18040): Terminated: ok {rc=0} 09:03:07.192862 --- ParallelTerminationStrategy: PID 18041 died... 09:03:07.211646 run iperf3-srv_10.42.42.10(pid=18041): Terminated {rc=256} 09:03:07.255741 --- ParallelTerminationStrategy: PID 18042 died... 09:03:07.274636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18042): Terminated: ok {rc=0} 09:03:07.319106 --- ParallelTerminationStrategy: PID 18043 died... 09:03:07.337766 run iperf3-srv_10.42.42.10(pid=18043): Terminated {rc=256} 09:03:07.381865 --- ParallelTerminationStrategy: PID 18044 died... 09:03:07.400717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18044): Terminated: ok {rc=0} 09:03:07.444901 --- ParallelTerminationStrategy: PID 18045 died... 09:03:07.463702 run iperf3-srv_10.42.42.10(pid=18045): Terminated {rc=256} 09:03:07.507576 --- ParallelTerminationStrategy: PID 18046 died... 09:03:07.526457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18046): Terminated: ok {rc=0} 09:03:07.570989 --- ParallelTerminationStrategy: PID 18047 died... 09:03:07.589871 run iperf3-srv_10.42.42.10(pid=18047): Terminated {rc=256} 09:03:07.634016 --- ParallelTerminationStrategy: PID 18051 died... 09:03:07.652689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18051): Terminated: ok {rc=0} 09:03:07.697548 --- ParallelTerminationStrategy: PID 18054 died... 09:03:07.716815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18054): Terminated: ok {rc=0} 09:03:07.761088 --- ParallelTerminationStrategy: PID 18057 died... 09:03:07.779968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18057): Terminated: ok {rc=0} 09:03:07.867026 bus /gobi_4: Setting Powered False 09:03:08.967103 bus /gobi_4: Setting Powered False 09:03:10.083474 bus /gobi_1: Setting Powered False 09:03:11.184295 bus /gobi_1: Setting Powered False 09:03:12.301299 bus /gobi_0: Setting Powered False 09:03:13.399527 bus /gobi_0: Setting Powered False 09:03:14.517199 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx ping.py ---------------------------------------------- 09:03:15.620477 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:15.632585 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:03:15.683678 tst ping.py: using LAC 20383 09:03:15.812595 tst ping.py: using RAC 238 09:03:15.967552 tst ping.py: using CellId 20383 09:03:16.092805 tst ping.py: using BVCI 20384 09:03:16.254548 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:16.270721 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:16.282569 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:16.300339 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:16.317836 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:16.335902 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:16.352263 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:16.368790 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:03:16.524122 tst ping.py:19: start network... 09:03:16.759004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:17.243950 run create_hlr_db(pid=18059): Launched 09:03:17.377556 bus /gobi_6: Setting Powered False 09:03:18.442025 run create_hlr_db(pid=18059): Terminated: ok {rc=0} 09:03:18.892910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18061): Launched 09:03:19.217271 run osmo-hlr_10.42.42.2(pid=18062): Launched 09:03:19.343099 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:19.903793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18064): Launched 09:03:20.228799 run osmo-stp_10.42.42.5(pid=18065): Launched 09:03:20.355253 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:20.923048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18067): Launched 09:03:21.047942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:21.323698 run patchelf(pid=18068): Launched 09:03:21.507304 run osmo-stp_10.42.42.5(pid=18065): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18065)] 09:03:21.645565 run osmo-stp_10.42.42.5(pid=18065): stdout: | (launched: 2022-12-09_09:03:20.169433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:21.784886 run osmo-stp_10.42.42.5(pid=18065): stderr: | [0;m[38;5;43m20221209090320358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090320358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090320358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090320358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090320359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090320359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090320359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:21.924716 run osmo-stp_10.42.42.5(pid=18065): stdout: | (launched: 2022-12-09_09:03:20.169433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:22.058547 run osmo-stp_10.42.42.5(pid=18065): stderr: | [0;m[38;5;43m20221209090320358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090320358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090320358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090320358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090320359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090320359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090320359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:22.216879 run patchelf(pid=18068): Terminating (SIGINT) 09:03:22.399700 run patchelf(pid=18068): Terminated: ok {rc=0} 09:03:22.531573 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18065): Process ended prematurely: osmo-stp_10.42.42.5(pid=18065) [trial-2357↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18065)] [trial-2357↪gprs:trx-umtrx↪ping.py:22] 09:03:22.541117 tst ping.py:22: Test FAILED (6.9 sec) 09:03:22.569624 run osmo-hlr_10.42.42.2(pid=18062): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18062)] 09:03:22.620691 run osmo-hlr_10.42.42.2(pid=18062): stdout: | (launched: 2022-12-09_09:03:19.158006) 09:03:22.673160 run osmo-hlr_10.42.42.2(pid=18062): stderr: | [0;m[1;31m20221209090319354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090319354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090319354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090319354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090319354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090319355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090319381 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090319390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090319391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090319391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:22.725919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18061): Terminating (SIGTERM) 09:03:22.768627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18064): Terminating (SIGTERM) 09:03:22.811716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18067): Terminating (SIGTERM) 09:03:22.854523 --- ParallelTerminationStrategy: PID 18061 died... 09:03:22.874986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18061): Terminated: ok {rc=0} 09:03:22.922754 --- ParallelTerminationStrategy: PID 18064 died... 09:03:22.942872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18064): Terminated: ok {rc=0} 09:03:22.989967 --- ParallelTerminationStrategy: PID 18067 died... 09:03:23.009895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18067): Terminated: ok {rc=0} 09:03:23.099314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 09:03:24.187274 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.199537 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:03:24.250498 tst ping_idle_ping.py: using LAC 20384 09:03:24.377756 tst ping_idle_ping.py: using RAC 239 09:03:24.506317 tst ping_idle_ping.py: using CellId 20384 09:03:24.632380 tst ping_idle_ping.py: using BVCI 20385 09:03:24.751262 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.762720 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.773927 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.785258 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.796598 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.807887 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.819281 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:03:24.830973 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:03:24.948563 tst ping_idle_ping.py:24: start network... 09:03:25.154283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:25.630188 run create_hlr_db(pid=18069): Launched 09:03:25.757338 bus /gobi_6: Setting Powered False 09:03:26.818496 run create_hlr_db(pid=18069): Terminated: ok {rc=0} 09:03:27.263216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18071): Launched 09:03:27.593178 run osmo-hlr_10.42.42.2(pid=18072): Launched 09:03:27.718568 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:28.280194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18074): Launched 09:03:28.607028 run osmo-stp_10.42.42.5(pid=18075): Launched 09:03:28.732803 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:29.296801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18077): Launched 09:03:29.423582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:29.698956 run patchelf(pid=18078): Launched 09:03:29.881563 run osmo-stp_10.42.42.5(pid=18075): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18075)] 09:03:30.019724 run osmo-stp_10.42.42.5(pid=18075): stdout: | (launched: 2022-12-09_09:03:28.547307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:30.159650 run osmo-stp_10.42.42.5(pid=18075): stderr: | [0;m[38;5;43m20221209090328735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090328736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090328737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090328737 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090328738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090328738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090328738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:30.299833 run osmo-stp_10.42.42.5(pid=18075): stdout: | (launched: 2022-12-09_09:03:28.547307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:30.434658 run osmo-stp_10.42.42.5(pid=18075): stderr: | [0;m[38;5;43m20221209090328735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090328736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090328737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090328737 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090328738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090328738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090328738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:30.593602 run patchelf(pid=18078): Terminating (SIGINT) 09:03:30.775977 run patchelf(pid=18078): Terminated: ok {rc=0} 09:03:30.909942 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18075): Process ended prematurely: osmo-stp_10.42.42.5(pid=18075) [trial-2357↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18075)] [trial-2357↪gprs:trx-umtrx↪ping_idle_ping.py:27] 09:03:30.920114 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:03:30.955378 run osmo-hlr_10.42.42.2(pid=18072): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18072)] 09:03:31.008149 run osmo-hlr_10.42.42.2(pid=18072): stdout: | (launched: 2022-12-09_09:03:27.533241) 09:03:31.062694 run osmo-hlr_10.42.42.2(pid=18072): stderr: | [0;m[1;31m20221209090327728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090327728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090327728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090327728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090327728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090327729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090327741 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090327751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090327751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090327751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:31.115359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18071): Terminating (SIGTERM) 09:03:31.158628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18074): Terminating (SIGTERM) 09:03:31.203597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18077): Terminating (SIGTERM) 09:03:31.248377 --- ParallelTerminationStrategy: PID 18071 died... 09:03:31.269049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18071): Terminated: ok {rc=0} 09:03:31.316351 --- ParallelTerminationStrategy: PID 18074 died... 09:03:31.336565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18074): Terminated: ok {rc=0} 09:03:31.383738 --- ParallelTerminationStrategy: PID 18077 died... 09:03:31.403349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18077): Terminated: ok {rc=0} 09:03:31.493260 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 09:03:32.805767 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:32.812080 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:03:32.846114 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:03:32.885502 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:03:32.973256 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:03:33.006414 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:03:33.045828 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:03:33.640797 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:03:33.690813 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:33.702024 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:03:33.752252 tst cs_paging_gprs_active.py: using LAC 20385 09:03:33.879446 tst cs_paging_gprs_active.py: using RAC 240 09:03:34.005135 tst cs_paging_gprs_active.py: using CellId 20385 09:03:34.125570 tst cs_paging_gprs_active.py: using BVCI 20386 09:03:34.238569 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.249639 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.260425 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.271294 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.282021 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.292645 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.303568 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.314414 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:34.325565 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:03:34.447465 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:03:34.568410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:03:34.778165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:35.089674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18082): Launched 09:03:35.359224 run iperf3-srv_10.42.42.10(pid=18083): Launched 09:03:35.475257 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:03:35.683786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:35.997289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18084): Launched 09:03:36.267194 run iperf3-srv_10.42.42.10(pid=18085): Launched 09:03:36.383094 tst cs_paging_gprs_active.py:38: start network... 09:03:36.591164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:37.073816 run create_hlr_db(pid=18086): Launched 09:03:37.200275 bus /gobi_6: Setting Powered False 09:03:38.262298 run create_hlr_db(pid=18086): Terminated: ok {rc=0} 09:03:38.714357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18088): Launched 09:03:39.047145 run osmo-hlr_10.42.42.2(pid=18089): Launched 09:03:39.176185 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:39.748189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18091): Launched 09:03:40.074405 run osmo-stp_10.42.42.5(pid=18092): Launched 09:03:40.195533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:40.732047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18094): Launched 09:03:40.851342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:41.113638 run patchelf(pid=18095): Launched 09:03:41.285119 run osmo-stp_10.42.42.5(pid=18092): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18092)] 09:03:41.416092 run osmo-stp_10.42.42.5(pid=18092): stdout: | (launched: 2022-12-09_09:03:40.017741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:41.548242 run osmo-stp_10.42.42.5(pid=18092): stderr: | [0;m[38;5;43m20221209090340183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090340183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090340183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090340184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090340184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090340184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090340184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:41.680341 run osmo-stp_10.42.42.5(pid=18092): stdout: | (launched: 2022-12-09_09:03:40.017741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:41.807104 run osmo-stp_10.42.42.5(pid=18092): stderr: | [0;m[38;5;43m20221209090340183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090340183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090340183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090340184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090340184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090340184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090340184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:41.957414 run patchelf(pid=18095): Terminating (SIGINT) 09:03:42.131558 run patchelf(pid=18095): Terminated: ok {rc=0} 09:03:42.256638 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18092): Process ended prematurely: osmo-stp_10.42.42.5(pid=18092) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18092)] [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:03:42.266111 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:03:42.293480 run osmo-hlr_10.42.42.2(pid=18089): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18089)] 09:03:42.341391 run osmo-hlr_10.42.42.2(pid=18089): stdout: | (launched: 2022-12-09_09:03:38.986772) 09:03:42.390980 run osmo-hlr_10.42.42.2(pid=18089): stderr: | [0;m[1;31m20221209090339182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090339183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090339183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090339183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090339183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090339183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090339196 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090339206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090339206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090339206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:42.441082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18082): Terminating (SIGTERM) 09:03:42.481301 run iperf3-srv_10.42.42.10(pid=18083): Terminating (SIGTERM) 09:03:42.521405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18084): Terminating (SIGTERM) 09:03:42.561463 run iperf3-srv_10.42.42.10(pid=18085): Terminating (SIGTERM) 09:03:42.601530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18088): Terminating (SIGTERM) 09:03:42.641671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18091): Terminating (SIGTERM) 09:03:42.681532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18094): Terminating (SIGTERM) 09:03:42.721706 --- ParallelTerminationStrategy: PID 18082 died... 09:03:42.741038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18082): Terminated: ok {rc=0} 09:03:42.785454 --- ParallelTerminationStrategy: PID 18083 died... 09:03:42.804130 run iperf3-srv_10.42.42.10(pid=18083): Terminated {rc=256} 09:03:42.848421 --- ParallelTerminationStrategy: PID 18084 died... 09:03:42.867345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18084): Terminated: ok {rc=0} 09:03:42.911547 --- ParallelTerminationStrategy: PID 18085 died... 09:03:42.930363 run iperf3-srv_10.42.42.10(pid=18085): Terminated {rc=256} 09:03:42.975119 --- ParallelTerminationStrategy: PID 18088 died... 09:03:42.994049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18088): Terminated: ok {rc=0} 09:03:43.038405 --- ParallelTerminationStrategy: PID 18091 died... 09:03:43.057400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18091): Terminated: ok {rc=0} 09:03:43.102143 --- ParallelTerminationStrategy: PID 18094 died... 09:03:43.121232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18094): Terminated: ok {rc=0} 09:03:43.206700 bus /gobi_0: Setting Powered False 09:03:44.307873 bus /gobi_0: Setting Powered False 09:03:45.425391 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:03:46.593746 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:46.609748 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:03:46.672746 tst iperf3.py: using LAC 20386 09:03:46.830688 tst iperf3.py: using RAC 241 09:03:47.003990 tst iperf3.py: using CellId 20386 09:03:47.153799 tst iperf3.py: using BVCI 20387 09:03:47.276789 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.289119 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.301709 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.314323 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.326245 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.338642 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.351202 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.362968 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:47.375052 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:03:47.495733 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:03:47.721682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:48.055257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18096): Launched 09:03:48.343340 run iperf3-srv_10.42.42.10(pid=18097): Launched 09:03:48.467813 tst iperf3.py:8: start network... 09:03:48.692004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:49.206109 run create_hlr_db(pid=18098): Launched 09:03:49.335172 bus /gobi_6: Setting Powered False 09:03:50.400022 run create_hlr_db(pid=18098): Terminated: ok {rc=0} 09:03:50.840941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18100): Launched 09:03:51.151270 run osmo-hlr_10.42.42.2(pid=18101): Launched 09:03:51.270578 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:51.823515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18103): Launched 09:03:52.133035 run osmo-stp_10.42.42.5(pid=18104): Launched 09:03:52.251419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:52.784019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18106): Launched 09:03:52.902015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:53.163509 run patchelf(pid=18107): Launched 09:03:53.334701 run osmo-stp_10.42.42.5(pid=18104): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18104)] 09:03:53.464629 run osmo-stp_10.42.42.5(pid=18104): stdout: | (launched: 2022-12-09_09:03:52.076009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:53.596691 run osmo-stp_10.42.42.5(pid=18104): stderr: | [0;m[38;5;43m20221209090352245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090352245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090352245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090352246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090352246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090352246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090352246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:53.728415 run osmo-stp_10.42.42.5(pid=18104): stdout: | (launched: 2022-12-09_09:03:52.076009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:53.854797 run osmo-stp_10.42.42.5(pid=18104): stderr: | [0;m[38;5;43m20221209090352245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090352245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090352245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090352246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090352246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090352246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090352246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:54.003930 run patchelf(pid=18107): Terminating (SIGINT) 09:03:54.177726 run patchelf(pid=18107): Terminated: ok {rc=0} 09:03:54.302280 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18104): Process ended prematurely: osmo-stp_10.42.42.5(pid=18104) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18104)] [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 09:03:54.311713 tst iperf3.py:8: Test FAILED (7.8 sec) 09:03:54.338851 run osmo-hlr_10.42.42.2(pid=18101): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18101)] 09:03:54.386416 run osmo-hlr_10.42.42.2(pid=18101): stdout: | (launched: 2022-12-09_09:03:51.094637) 09:03:54.436369 run osmo-hlr_10.42.42.2(pid=18101): stderr: | [0;m[1;31m20221209090351266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090351266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090351266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090351266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090351266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090351266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090351278 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090351287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090351287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090351287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:54.486257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18096): Terminating (SIGTERM) 09:03:54.526294 run iperf3-srv_10.42.42.10(pid=18097): Terminating (SIGTERM) 09:03:54.566175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18100): Terminating (SIGTERM) 09:03:54.606145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18103): Terminating (SIGTERM) 09:03:54.645940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18106): Terminating (SIGTERM) 09:03:54.686192 --- ParallelTerminationStrategy: PID 18096 died... 09:03:54.705352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18096): Terminated: ok {rc=0} 09:03:54.749433 --- ParallelTerminationStrategy: PID 18097 died... 09:03:54.768186 run iperf3-srv_10.42.42.10(pid=18097): Terminated {rc=256} 09:03:54.811992 --- ParallelTerminationStrategy: PID 18100 died... 09:03:54.830862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18100): Terminated: ok {rc=0} 09:03:54.874593 --- ParallelTerminationStrategy: PID 18103 died... 09:03:54.893299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18103): Terminated: ok {rc=0} 09:03:54.937206 --- ParallelTerminationStrategy: PID 18106 died... 09:03:54.955756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18106): Terminated: ok {rc=0} 09:03:55.040179 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:03:56.191586 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.203872 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:03:56.258619 tst iperf3m4.py: using LAC 20387 09:03:56.389912 tst iperf3m4.py: using RAC 242 09:03:56.520725 tst iperf3m4.py: using CellId 20387 09:03:56.650796 tst iperf3m4.py: using BVCI 20388 09:03:56.773935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.785661 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.797014 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.809068 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.821527 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.833546 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.845872 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.858862 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:03:56.870512 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:03:56.994141 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:03:57.116494 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:03:57.239320 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:03:57.359262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:03:57.568060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:57.879279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18108): Launched 09:03:58.149764 run iperf3-srv_10.42.42.10(pid=18109): Launched 09:03:58.265831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:03:58.473113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:58.782904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18110): Launched 09:03:59.053557 run iperf3-srv_10.42.42.10(pid=18111): Launched 09:03:59.169828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:03:59.377475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:59.688098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18112): Launched 09:03:59.957741 run iperf3-srv_10.42.42.10(pid=18113): Launched 09:04:00.073732 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:04:00.282075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:00.593043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18114): Launched 09:04:00.873721 run iperf3-srv_10.42.42.10(pid=18115): Launched 09:04:01.038018 tst iperf3m4.py:8: start network... 09:04:01.280880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:01.809392 run create_hlr_db(pid=18116): Launched 09:04:01.973345 bus /gobi_6: Setting Powered False 09:04:03.038653 run create_hlr_db(pid=18116): Terminated: ok {rc=0} 09:04:03.503892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18118): Launched 09:04:03.837385 run osmo-hlr_10.42.42.2(pid=18119): Launched 09:04:03.963873 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:04.535785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18121): Launched 09:04:04.870739 run osmo-stp_10.42.42.5(pid=18122): Launched 09:04:04.999222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:05.575117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18124): Launched 09:04:05.703375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:05.983482 run patchelf(pid=18125): Launched 09:04:06.168404 run osmo-stp_10.42.42.5(pid=18122): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18122)] 09:04:06.308000 run osmo-stp_10.42.42.5(pid=18122): stdout: | (launched: 2022-12-09_09:04:04.809929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:06.449604 run osmo-stp_10.42.42.5(pid=18122): stderr: | [0;m[38;5;43m20221209090404998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090404999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090404999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090404999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090405000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090405000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090405000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:06.591590 run osmo-stp_10.42.42.5(pid=18122): stdout: | (launched: 2022-12-09_09:04:04.809929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:06.727576 run osmo-stp_10.42.42.5(pid=18122): stderr: | [0;m[38;5;43m20221209090404998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090404999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090404999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090404999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090405000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090405000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090405000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:06.888427 run patchelf(pid=18125): Terminating (SIGINT) 09:04:07.073682 run patchelf(pid=18125): Terminated: ok {rc=0} 09:04:07.207854 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18122): Process ended prematurely: osmo-stp_10.42.42.5(pid=18122) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18122)] [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 09:04:07.218232 tst iperf3m4.py:8: Test FAILED (11.1 sec) 09:04:07.247784 run osmo-hlr_10.42.42.2(pid=18119): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18119)] 09:04:07.297948 run osmo-hlr_10.42.42.2(pid=18119): stdout: | (launched: 2022-12-09_09:04:03.776604) 09:04:07.349774 run osmo-hlr_10.42.42.2(pid=18119): stderr: | [0;m[1;31m20221209090403975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090403975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090403975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090403975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090403975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090403975 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090403988 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090403998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090403998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090403998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:07.402363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18108): Terminating (SIGTERM) 09:04:07.444659 run iperf3-srv_10.42.42.10(pid=18109): Terminating (SIGTERM) 09:04:07.487042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18110): Terminating (SIGTERM) 09:04:07.529396 run iperf3-srv_10.42.42.10(pid=18111): Terminating (SIGTERM) 09:04:07.571543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18112): Terminating (SIGTERM) 09:04:07.613871 run iperf3-srv_10.42.42.10(pid=18113): Terminating (SIGTERM) 09:04:07.656196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18114): Terminating (SIGTERM) 09:04:07.698543 run iperf3-srv_10.42.42.10(pid=18115): Terminating (SIGTERM) 09:04:07.740586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18118): Terminating (SIGTERM) 09:04:07.783021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18121): Terminating (SIGTERM) 09:04:07.825193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18124): Terminating (SIGTERM) 09:04:07.867656 --- ParallelTerminationStrategy: PID 18108 died... 09:04:07.887801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18108): Terminated: ok {rc=0} 09:04:07.934627 --- ParallelTerminationStrategy: PID 18109 died... 09:04:07.954244 run iperf3-srv_10.42.42.10(pid=18109): Terminated {rc=256} 09:04:08.000774 --- ParallelTerminationStrategy: PID 18110 died... 09:04:08.020739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18110): Terminated: ok {rc=0} 09:04:08.067577 --- ParallelTerminationStrategy: PID 18111 died... 09:04:08.087231 run iperf3-srv_10.42.42.10(pid=18111): Terminated {rc=256} 09:04:08.133677 --- ParallelTerminationStrategy: PID 18112 died... 09:04:08.153376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18112): Terminated: ok {rc=0} 09:04:08.200588 --- ParallelTerminationStrategy: PID 18113 died... 09:04:08.220279 run iperf3-srv_10.42.42.10(pid=18113): Terminated {rc=256} 09:04:08.266878 --- ParallelTerminationStrategy: PID 18114 died... 09:04:08.286576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18114): Terminated: ok {rc=0} 09:04:08.333281 --- ParallelTerminationStrategy: PID 18115 died... 09:04:08.353005 run iperf3-srv_10.42.42.10(pid=18115): Terminated {rc=256} 09:04:08.399349 --- ParallelTerminationStrategy: PID 18118 died... 09:04:08.419404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18118): Terminated: ok {rc=0} 09:04:08.466521 --- ParallelTerminationStrategy: PID 18121 died... 09:04:08.486373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18121): Terminated: ok {rc=0} 09:04:08.533256 --- ParallelTerminationStrategy: PID 18124 died... 09:04:08.552904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18124): Terminated: ok {rc=0} 09:04:08.641040 bus /gobi_4: Setting Powered False 09:04:09.740767 bus /gobi_4: Setting Powered False 09:04:10.857930 bus /gobi_1: Setting Powered False 09:04:11.957833 bus /gobi_1: Setting Powered False 09:04:13.074516 bus /gobi_0: Setting Powered False 09:04:14.172608 bus /gobi_0: Setting Powered False 09:04:15.290731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 09:04:16.399339 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:16.412511 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:04:16.464085 tst ping.py: using LAC 20388 09:04:16.634741 tst ping.py: using RAC 243 09:04:16.765658 tst ping.py: using CellId 20388 09:04:16.895816 tst ping.py: using BVCI 20389 09:04:17.019189 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:17.031786 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:17.045437 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:17.058858 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:17.071140 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:17.085486 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:17.099101 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:17.111580 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:04:17.236431 tst ping.py:19: start network... 09:04:17.457819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:17.963511 run create_hlr_db(pid=18126): Launched 09:04:18.089536 bus /gobi_6: Setting Powered False 09:04:19.154009 run create_hlr_db(pid=18126): Terminated: ok {rc=0} 09:04:19.589971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Launched 09:04:19.894434 run osmo-hlr_10.42.42.2(pid=18129): Launched 09:04:20.010197 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:20.552760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Launched 09:04:20.857652 run osmo-stp_10.42.42.5(pid=18132): Launched 09:04:20.973714 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:21.495552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18134): Launched 09:04:21.611438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:21.868476 run patchelf(pid=18135): Launched 09:04:22.037675 run osmo-stp_10.42.42.5(pid=18132): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] 09:04:22.165961 run osmo-stp_10.42.42.5(pid=18132): stdout: | (launched: 2022-12-09_09:04:20.801643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:22.296715 run osmo-stp_10.42.42.5(pid=18132): stderr: | [0;m[38;5;43m20221209090420968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090420969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090420969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090420969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090420970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090420970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090420970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:22.426853 run osmo-stp_10.42.42.5(pid=18132): stdout: | (launched: 2022-12-09_09:04:20.801643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:22.551651 run osmo-stp_10.42.42.5(pid=18132): stderr: | [0;m[38;5;43m20221209090420968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090420969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090420969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090420969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090420970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090420970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090420970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:22.699364 run patchelf(pid=18135): Terminating (SIGINT) 09:04:22.868794 run patchelf(pid=18135): Terminated: ok {rc=0} 09:04:22.991130 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18132): Process ended prematurely: osmo-stp_10.42.42.5(pid=18132) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 09:04:23.000100 tst ping.py:22: Test FAILED (6.6 sec) 09:04:23.026964 run osmo-hlr_10.42.42.2(pid=18129): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18129)] 09:04:23.074981 run osmo-hlr_10.42.42.2(pid=18129): stdout: | (launched: 2022-12-09_09:04:19.838448) 09:04:23.124644 run osmo-hlr_10.42.42.2(pid=18129): stderr: | [0;m[1;31m20221209090420012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090420012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090420012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090420012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090420012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090420012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090420023 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090420031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090420032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090420032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:23.174587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Terminating (SIGTERM) 09:04:23.215027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Terminating (SIGTERM) 09:04:23.255644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18134): Terminating (SIGTERM) 09:04:23.296648 --- ParallelTerminationStrategy: PID 18128 died... 09:04:23.316056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Terminated: ok {rc=0} 09:04:23.360625 --- ParallelTerminationStrategy: PID 18131 died... 09:04:23.379635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Terminated: ok {rc=0} 09:04:23.423910 --- ParallelTerminationStrategy: PID 18134 died... 09:04:23.442882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18134): Terminated: ok {rc=0} 09:04:23.528896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:04:24.619654 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:24.632145 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:04:24.687346 tst ping_idle_ping.py: using LAC 20389 09:04:24.816823 tst ping_idle_ping.py: using RAC 244 09:04:24.945303 tst ping_idle_ping.py: using CellId 20389 09:04:25.073624 tst ping_idle_ping.py: using BVCI 20390 09:04:25.193547 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:25.205348 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:25.216810 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:25.228851 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:25.241082 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:25.253060 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:25.265511 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:04:25.278738 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:04:25.401163 tst ping_idle_ping.py:24: start network... 09:04:25.622178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:26.131651 run create_hlr_db(pid=18136): Launched 09:04:26.256422 bus /gobi_6: Setting Powered False 09:04:27.321538 run create_hlr_db(pid=18136): Terminated: ok {rc=0} 09:04:27.759828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18138): Launched 09:04:28.067598 run osmo-hlr_10.42.42.2(pid=18139): Launched 09:04:28.184015 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:28.711193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18141): Launched 09:04:29.017303 run osmo-stp_10.42.42.5(pid=18142): Launched 09:04:29.134217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:29.661672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18144): Launched 09:04:29.778262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:30.036175 run patchelf(pid=18145): Launched 09:04:30.206489 run osmo-stp_10.42.42.5(pid=18142): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18142)] 09:04:30.336266 run osmo-stp_10.42.42.5(pid=18142): stdout: | (launched: 2022-12-09_09:04:28.960594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:30.467838 run osmo-stp_10.42.42.5(pid=18142): stderr: | [0;m[38;5;43m20221209090429128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090429129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090429129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090429129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090429130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090429130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090429130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:30.598768 run osmo-stp_10.42.42.5(pid=18142): stdout: | (launched: 2022-12-09_09:04:28.960594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:30.724339 run osmo-stp_10.42.42.5(pid=18142): stderr: | [0;m[38;5;43m20221209090429128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090429129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090429129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090429129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090429130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090429130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090429130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:30.879863 run patchelf(pid=18145): Terminating (SIGINT) 09:04:31.069753 run patchelf(pid=18145): Terminated: ok {rc=0} 09:04:31.206437 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18142): Process ended prematurely: osmo-stp_10.42.42.5(pid=18142) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18142)] [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 09:04:31.217341 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:04:31.249451 run osmo-hlr_10.42.42.2(pid=18139): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18139)] 09:04:31.302898 run osmo-hlr_10.42.42.2(pid=18139): stdout: | (launched: 2022-12-09_09:04:28.011151) 09:04:31.359068 run osmo-hlr_10.42.42.2(pid=18139): stderr: | [0;m[1;31m20221209090428187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090428187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090428187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090428187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090428187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090428187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090428199 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090428207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090428207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090428207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:31.414878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18138): Terminating (SIGTERM) 09:04:31.460939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18141): Terminating (SIGTERM) 09:04:31.507534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18144): Terminating (SIGTERM) 09:04:31.555664 --- ParallelTerminationStrategy: PID 18138 died... 09:04:31.576755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18138): Terminated: ok {rc=0} 09:04:31.629133 --- ParallelTerminationStrategy: PID 18141 died... 09:04:31.649778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18141): Terminated: ok {rc=0} 09:04:31.700489 --- ParallelTerminationStrategy: PID 18144 died... 09:04:31.721543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18144): Terminated: ok {rc=0} 09:04:31.815534 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:04:33.126056 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:04:33.131775 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:04:33.164354 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:04:33.203481 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:04:33.291237 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:04:33.324038 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:04:33.362903 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:04:33.960387 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:04:34.010342 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.021411 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:04:34.090625 tst cs_paging_gprs_active.py: using LAC 20390 09:04:34.214583 tst cs_paging_gprs_active.py: using RAC 245 09:04:34.338172 tst cs_paging_gprs_active.py: using CellId 20390 09:04:34.462678 tst cs_paging_gprs_active.py: using BVCI 20391 09:04:34.577838 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.588829 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.599846 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.610786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.621601 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.632505 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.643522 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.654440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:34.665522 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:04:34.784728 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:04:34.907078 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:04:35.117245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:35.429589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18152): Launched 09:04:35.699205 run iperf3-srv_10.42.42.10(pid=18153): Launched 09:04:35.815287 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:04:36.023303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:36.334433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18154): Launched 09:04:36.605677 run iperf3-srv_10.42.42.10(pid=18155): Launched 09:04:36.721457 tst cs_paging_gprs_active.py:38: start network... 09:04:36.928926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:37.410474 run create_hlr_db(pid=18156): Launched 09:04:37.539650 bus /gobi_6: Setting Powered False 09:04:38.601465 run create_hlr_db(pid=18156): Terminated: ok {rc=0} 09:04:39.054442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18158): Launched 09:04:39.388205 run osmo-hlr_10.42.42.2(pid=18159): Launched 09:04:39.515678 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:40.088712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18161): Launched 09:04:40.423079 run osmo-stp_10.42.42.5(pid=18162): Launched 09:04:40.555034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:41.130962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18164): Launched 09:04:41.258306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:41.547389 run patchelf(pid=18165): Launched 09:04:41.734393 run osmo-stp_10.42.42.5(pid=18162): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18162)] 09:04:41.875483 run osmo-stp_10.42.42.5(pid=18162): stdout: | (launched: 2022-12-09_09:04:40.362362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:42.018160 run osmo-stp_10.42.42.5(pid=18162): stderr: | [0;m[38;5;43m20221209090440553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090440553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090440553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090440554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090440554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090440554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090440554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:42.160748 run osmo-stp_10.42.42.5(pid=18162): stdout: | (launched: 2022-12-09_09:04:40.362362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:42.297441 run osmo-stp_10.42.42.5(pid=18162): stderr: | [0;m[38;5;43m20221209090440553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090440553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090440553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090440554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090440554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090440554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090440554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:42.460095 run patchelf(pid=18165): Terminating (SIGINT) 09:04:42.646760 run patchelf(pid=18165): Terminated: ok {rc=0} 09:04:42.780898 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18162): Process ended prematurely: osmo-stp_10.42.42.5(pid=18162) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18162)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:04:42.791259 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:04:42.820634 run osmo-hlr_10.42.42.2(pid=18159): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18159)] 09:04:42.871350 run osmo-hlr_10.42.42.2(pid=18159): stdout: | (launched: 2022-12-09_09:04:39.327461) 09:04:42.923415 run osmo-hlr_10.42.42.2(pid=18159): stderr: | [0;m[1;31m20221209090439523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090439523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090439523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090439523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090439523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090439523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090439535 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090439545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090439545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090439545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:42.976156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18152): Terminating (SIGTERM) 09:04:43.018542 run iperf3-srv_10.42.42.10(pid=18153): Terminating (SIGTERM) 09:04:43.060669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18154): Terminating (SIGTERM) 09:04:43.103344 run iperf3-srv_10.42.42.10(pid=18155): Terminating (SIGTERM) 09:04:43.145461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18158): Terminating (SIGTERM) 09:04:43.187470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18161): Terminating (SIGTERM) 09:04:43.229775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18164): Terminating (SIGTERM) 09:04:43.272297 --- ParallelTerminationStrategy: PID 18152 died... 09:04:43.292538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18152): Terminated: ok {rc=0} 09:04:43.339494 --- ParallelTerminationStrategy: PID 18153 died... 09:04:43.358933 run iperf3-srv_10.42.42.10(pid=18153): Terminated {rc=256} 09:04:43.405875 --- ParallelTerminationStrategy: PID 18154 died... 09:04:43.425909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18154): Terminated: ok {rc=0} 09:04:43.473080 --- ParallelTerminationStrategy: PID 18155 died... 09:04:43.492641 run iperf3-srv_10.42.42.10(pid=18155): Terminated {rc=256} 09:04:43.539297 --- ParallelTerminationStrategy: PID 18158 died... 09:04:43.558989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18158): Terminated: ok {rc=0} 09:04:43.605988 --- ParallelTerminationStrategy: PID 18161 died... 09:04:43.625708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18161): Terminated: ok {rc=0} 09:04:43.672590 --- ParallelTerminationStrategy: PID 18164 died... 09:04:43.692256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18164): Terminated: ok {rc=0} 09:04:43.780083 bus /gobi_0: Setting Powered False 09:04:44.880013 bus /gobi_0: Setting Powered False 09:04:45.994505 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:04:47.141077 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.153526 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:04:47.228330 tst iperf3.py: using LAC 20391 09:04:47.352133 tst iperf3.py: using RAC 246 09:04:47.473623 tst iperf3.py: using CellId 20391 09:04:47.592880 tst iperf3.py: using BVCI 20392 09:04:47.705304 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.716277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.727201 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.738181 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.748921 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.759790 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.770727 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.781542 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:47.792497 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:04:47.914832 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:04:48.138667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:48.470981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18166): Launched 09:04:48.760323 run iperf3-srv_10.42.42.10(pid=18167): Launched 09:04:48.884370 tst iperf3.py:8: start network... 09:04:49.107650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:49.622559 run create_hlr_db(pid=18168): Launched 09:04:49.749239 bus /gobi_6: Setting Powered False 09:04:50.810227 run create_hlr_db(pid=18168): Terminated: ok {rc=0} 09:04:51.271778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18170): Launched 09:04:51.603897 run osmo-hlr_10.42.42.2(pid=18171): Launched 09:04:51.731577 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:52.394849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18173): Launched 09:04:52.720326 run osmo-stp_10.42.42.5(pid=18174): Launched 09:04:52.845224 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:53.405358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18176): Launched 09:04:53.529860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:53.803989 run patchelf(pid=18177): Launched 09:04:53.983025 run osmo-stp_10.42.42.5(pid=18174): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18174)] 09:04:54.119718 run osmo-stp_10.42.42.5(pid=18174): stdout: | (launched: 2022-12-09_09:04:52.661206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:54.257943 run osmo-stp_10.42.42.5(pid=18174): stderr: | [0;m[38;5;43m20221209090452852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090452853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090452853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090452853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090452854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090452854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090452854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:54.396042 run osmo-stp_10.42.42.5(pid=18174): stdout: | (launched: 2022-12-09_09:04:52.661206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:54.529189 run osmo-stp_10.42.42.5(pid=18174): stderr: | [0;m[38;5;43m20221209090452852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090452853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090452853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090452853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090452854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090452854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090452854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:54.686239 run patchelf(pid=18177): Terminating (SIGINT) 09:04:54.866452 run patchelf(pid=18177): Terminated: ok {rc=0} 09:04:54.996832 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18174): Process ended prematurely: osmo-stp_10.42.42.5(pid=18174) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18174)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 09:04:55.006921 tst iperf3.py:8: Test FAILED (7.9 sec) 09:04:55.035884 run osmo-hlr_10.42.42.2(pid=18171): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18171)] 09:04:55.085882 run osmo-hlr_10.42.42.2(pid=18171): stdout: | (launched: 2022-12-09_09:04:51.543247) 09:04:55.137662 run osmo-hlr_10.42.42.2(pid=18171): stderr: | [0;m[1;31m20221209090451741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090451741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090451741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090451741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090451741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090451741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090451754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090451762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090451762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090451762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:55.189749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18166): Terminating (SIGTERM) 09:04:55.231524 run iperf3-srv_10.42.42.10(pid=18167): Terminating (SIGTERM) 09:04:55.273520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18170): Terminating (SIGTERM) 09:04:55.315419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18173): Terminating (SIGTERM) 09:04:55.357308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18176): Terminating (SIGTERM) 09:04:55.399323 --- ParallelTerminationStrategy: PID 18166 died... 09:04:55.419260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18166): Terminated: ok {rc=0} 09:04:55.466099 --- ParallelTerminationStrategy: PID 18167 died... 09:04:55.485670 run iperf3-srv_10.42.42.10(pid=18167): Terminated {rc=256} 09:04:55.532013 --- ParallelTerminationStrategy: PID 18170 died... 09:04:55.551664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18170): Terminated: ok {rc=0} 09:04:55.598403 --- ParallelTerminationStrategy: PID 18173 died... 09:04:55.617834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18173): Terminated: ok {rc=0} 09:04:55.664218 --- ParallelTerminationStrategy: PID 18176 died... 09:04:55.683611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18176): Terminated: ok {rc=0} 09:04:55.772538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:04:56.917637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:56.929377 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:04:56.997679 tst iperf3m4.py: using LAC 20392 09:04:57.115435 tst iperf3m4.py: using RAC 247 09:04:57.234309 tst iperf3m4.py: using CellId 20392 09:04:57.354284 tst iperf3m4.py: using BVCI 20393 09:04:57.466091 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.477096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.487862 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.498681 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.509500 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.520311 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.531644 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.542333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:04:57.553330 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:04:57.670889 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:04:57.793610 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:04:57.913781 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:04:58.032540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:04:58.236627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:58.541105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18178): Launched 09:04:58.806119 run iperf3-srv_10.42.42.10(pid=18179): Launched 09:04:58.919641 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:04:59.123118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:59.427625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18180): Launched 09:04:59.692240 run iperf3-srv_10.42.42.10(pid=18181): Launched 09:04:59.805724 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:05:00.009023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:00.314756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18182): Launched 09:05:00.579342 run iperf3-srv_10.42.42.10(pid=18183): Launched 09:05:00.693575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:05:00.914693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:01.236646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18187): Launched 09:05:01.518024 run iperf3-srv_10.42.42.10(pid=18188): Launched 09:05:01.662187 tst iperf3m4.py:8: start network... 09:05:01.892543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:02.412427 run create_hlr_db(pid=18189): Launched 09:05:02.538538 bus /gobi_6: Setting Powered False 09:05:03.603370 run create_hlr_db(pid=18189): Terminated: ok {rc=0} 09:05:04.036741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18191): Launched 09:05:04.342286 run osmo-hlr_10.42.42.2(pid=18192): Launched 09:05:04.457643 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:04.997353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18194): Launched 09:05:05.301166 run osmo-stp_10.42.42.5(pid=18195): Launched 09:05:05.417141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:05.955623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18197): Launched 09:05:06.071354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:06.329317 run patchelf(pid=18198): Launched 09:05:06.497649 run osmo-stp_10.42.42.5(pid=18195): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18195)] 09:05:06.626416 run osmo-stp_10.42.42.5(pid=18195): stdout: | (launched: 2022-12-09_09:05:05.244659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:06.757542 run osmo-stp_10.42.42.5(pid=18195): stderr: | [0;m[38;5;43m20221209090505413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090505413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090505413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090505414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090505414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090505414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090505414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:06.887616 run osmo-stp_10.42.42.5(pid=18195): stdout: | (launched: 2022-12-09_09:05:05.244659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:07.012183 run osmo-stp_10.42.42.5(pid=18195): stderr: | [0;m[38;5;43m20221209090505413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090505413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090505413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090505414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090505414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090505414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090505414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:07.159735 run patchelf(pid=18198): Terminating (SIGINT) 09:05:07.329805 run patchelf(pid=18198): Terminated: ok {rc=0} 09:05:07.452652 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18195): Process ended prematurely: osmo-stp_10.42.42.5(pid=18195) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18195)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:05:07.462276 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:05:07.489712 run osmo-hlr_10.42.42.2(pid=18192): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18192)] 09:05:07.537810 run osmo-hlr_10.42.42.2(pid=18192): stdout: | (launched: 2022-12-09_09:05:04.284811) 09:05:07.587467 run osmo-hlr_10.42.42.2(pid=18192): stderr: | [0;m[1;31m20221209090504460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090504460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090504460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090504460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090504460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090504460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090504472 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090504481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090504482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090504482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:07.637619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18178): Terminating (SIGTERM) 09:05:07.677771 run iperf3-srv_10.42.42.10(pid=18179): Terminating (SIGTERM) 09:05:07.717607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18180): Terminating (SIGTERM) 09:05:07.757235 run iperf3-srv_10.42.42.10(pid=18181): Terminating (SIGTERM) 09:05:07.796787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18182): Terminating (SIGTERM) 09:05:07.836429 run iperf3-srv_10.42.42.10(pid=18183): Terminating (SIGTERM) 09:05:07.875870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18187): Terminating (SIGTERM) 09:05:07.915228 run iperf3-srv_10.42.42.10(pid=18188): Terminating (SIGTERM) 09:05:07.954760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18191): Terminating (SIGTERM) 09:05:07.994532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18194): Terminating (SIGTERM) 09:05:08.034060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18197): Terminating (SIGTERM) 09:05:08.073861 --- ParallelTerminationStrategy: PID 18178 died... 09:05:08.092835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18178): Terminated: ok {rc=0} 09:05:08.136616 --- ParallelTerminationStrategy: PID 18179 died... 09:05:08.155030 run iperf3-srv_10.42.42.10(pid=18179): Terminated {rc=256} 09:05:08.198773 --- ParallelTerminationStrategy: PID 18180 died... 09:05:08.217275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18180): Terminated: ok {rc=0} 09:05:08.260671 --- ParallelTerminationStrategy: PID 18181 died... 09:05:08.279008 run iperf3-srv_10.42.42.10(pid=18181): Terminated {rc=256} 09:05:08.322401 --- ParallelTerminationStrategy: PID 18182 died... 09:05:08.340899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18182): Terminated: ok {rc=0} 09:05:08.384523 --- ParallelTerminationStrategy: PID 18183 died... 09:05:08.402959 run iperf3-srv_10.42.42.10(pid=18183): Terminated {rc=256} 09:05:08.446318 --- ParallelTerminationStrategy: PID 18187 died... 09:05:08.464814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18187): Terminated: ok {rc=0} 09:05:08.508314 --- ParallelTerminationStrategy: PID 18188 died... 09:05:08.526863 run iperf3-srv_10.42.42.10(pid=18188): Terminated {rc=256} 09:05:08.570765 --- ParallelTerminationStrategy: PID 18191 died... 09:05:08.589318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18191): Terminated: ok {rc=0} 09:05:08.632575 --- ParallelTerminationStrategy: PID 18194 died... 09:05:08.651447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18194): Terminated: ok {rc=0} 09:05:08.695118 --- ParallelTerminationStrategy: PID 18197 died... 09:05:08.713749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18197): Terminated: ok {rc=0} 09:05:08.799276 bus /gobi_4: Setting Powered False 09:05:09.899487 bus /gobi_4: Setting Powered False 09:05:11.013683 bus /gobi_1: Setting Powered False 09:05:12.112511 bus /gobi_1: Setting Powered False 09:05:13.228445 bus /gobi_0: Setting Powered False 09:05:14.325815 bus /gobi_0: Setting Powered False 09:05:15.442516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:05:16.546205 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:16.559790 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:05:16.637597 tst ping.py: using LAC 20393 09:05:16.785402 tst ping.py: using RAC 248 09:05:16.965313 tst ping.py: using CellId 20393 09:05:17.121072 tst ping.py: using BVCI 20394 09:05:17.231137 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:17.242425 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:17.253502 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:17.264713 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:17.276196 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:17.287113 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:17.298119 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:17.308940 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:05:17.428342 tst ping.py:19: start network... 09:05:17.645132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:18.143908 run create_hlr_db(pid=18199): Launched 09:05:18.265778 bus /gobi_6: Setting Powered False 09:05:19.329509 run create_hlr_db(pid=18199): Terminated: ok {rc=0} 09:05:19.757504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18201): Launched 09:05:20.056927 run osmo-hlr_10.42.42.2(pid=18202): Launched 09:05:20.171203 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:20.686628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18204): Launched 09:05:20.987542 run osmo-stp_10.42.42.5(pid=18205): Launched 09:05:21.101542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:21.618501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18207): Launched 09:05:21.732456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:21.986103 run patchelf(pid=18208): Launched 09:05:22.151522 run osmo-stp_10.42.42.5(pid=18205): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18205)] 09:05:22.278175 run osmo-stp_10.42.42.5(pid=18205): stdout: | (launched: 2022-12-09_09:05:20.931753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:22.406206 run osmo-stp_10.42.42.5(pid=18205): stderr: | [0;m[38;5;43m20221209090521099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090521100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090521100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090521100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090521101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090521101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090521101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:22.534449 run osmo-stp_10.42.42.5(pid=18205): stdout: | (launched: 2022-12-09_09:05:20.931753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:22.657337 run osmo-stp_10.42.42.5(pid=18205): stderr: | [0;m[38;5;43m20221209090521099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090521100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090521100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090521100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090521101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090521101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090521101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:22.803357 run patchelf(pid=18208): Terminating (SIGINT) 09:05:22.970520 run patchelf(pid=18208): Terminated: ok {rc=0} 09:05:23.090932 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18205): Process ended prematurely: osmo-stp_10.42.42.5(pid=18205) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18205)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 09:05:23.099786 tst ping.py:22: Test FAILED (6.5 sec) 09:05:23.126214 run osmo-hlr_10.42.42.2(pid=18202): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18202)] 09:05:23.173531 run osmo-hlr_10.42.42.2(pid=18202): stdout: | (launched: 2022-12-09_09:05:20.001953) 09:05:23.222369 run osmo-hlr_10.42.42.2(pid=18202): stderr: | [0;m[1;31m20221209090520173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090520173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090520173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090520173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090520173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090520173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090520185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090520193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090520194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090520194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:23.271595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18201): Terminating (SIGTERM) 09:05:23.311082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18204): Terminating (SIGTERM) 09:05:23.350370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18207): Terminating (SIGTERM) 09:05:23.390049 --- ParallelTerminationStrategy: PID 18201 died... 09:05:23.408768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18201): Terminated: ok {rc=0} 09:05:23.452538 --- ParallelTerminationStrategy: PID 18204 died... 09:05:23.471038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18204): Terminated: ok {rc=0} 09:05:23.514331 --- ParallelTerminationStrategy: PID 18207 died... 09:05:23.532861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18207): Terminated: ok {rc=0} 09:05:23.617633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:05:24.706205 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:24.718475 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:05:24.791162 tst ping_idle_ping.py: using LAC 20394 09:05:24.910767 tst ping_idle_ping.py: using RAC 249 09:05:25.028698 tst ping_idle_ping.py: using CellId 20394 09:05:25.147727 tst ping_idle_ping.py: using BVCI 20395 09:05:25.258185 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:25.269238 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:25.280085 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:25.290999 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:25.301883 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:25.312670 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:25.323646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:05:25.334470 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:05:25.455145 tst ping_idle_ping.py:24: start network... 09:05:25.672193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:26.169108 run create_hlr_db(pid=18209): Launched 09:05:26.294339 bus /gobi_6: Setting Powered False 09:05:27.357822 run create_hlr_db(pid=18209): Terminated: ok {rc=0} 09:05:27.787845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18211): Launched 09:05:28.087987 run osmo-hlr_10.42.42.2(pid=18212): Launched 09:05:28.202288 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:28.719597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18214): Launched 09:05:29.022895 run osmo-stp_10.42.42.5(pid=18215): Launched 09:05:29.137963 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:29.657989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18217): Launched 09:05:29.772869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:30.027196 run patchelf(pid=18218): Launched 09:05:30.194038 run osmo-stp_10.42.42.5(pid=18215): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18215)] 09:05:30.321518 run osmo-stp_10.42.42.5(pid=18215): stdout: | (launched: 2022-12-09_09:05:28.966459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:30.450816 run osmo-stp_10.42.42.5(pid=18215): stderr: | [0;m[38;5;43m20221209090529135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090529135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090529136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090529136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090529136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090529137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090529137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:30.580074 run osmo-stp_10.42.42.5(pid=18215): stdout: | (launched: 2022-12-09_09:05:28.966459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:30.704020 run osmo-stp_10.42.42.5(pid=18215): stderr: | [0;m[38;5;43m20221209090529135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090529135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090529136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090529136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090529136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090529137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090529137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:30.855260 run patchelf(pid=18218): Terminating (SIGINT) 09:05:31.039264 run patchelf(pid=18218): Terminated: ok {rc=0} 09:05:31.163486 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18215): Process ended prematurely: osmo-stp_10.42.42.5(pid=18215) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18215)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:05:31.173618 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:05:31.201599 run osmo-hlr_10.42.42.2(pid=18212): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18212)] 09:05:31.250062 run osmo-hlr_10.42.42.2(pid=18212): stdout: | (launched: 2022-12-09_09:05:28.032800) 09:05:31.300430 run osmo-hlr_10.42.42.2(pid=18212): stderr: | [0;m[1;31m20221209090528205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090528205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090528205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090528205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090528205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090528205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090528220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090528231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090528231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090528231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:31.351229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18211): Terminating (SIGTERM) 09:05:31.392037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18214): Terminating (SIGTERM) 09:05:31.433450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18217): Terminating (SIGTERM) 09:05:31.476215 --- ParallelTerminationStrategy: PID 18211 died... 09:05:31.495681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18211): Terminated: ok {rc=0} 09:05:31.540167 --- ParallelTerminationStrategy: PID 18214 died... 09:05:31.559298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18214): Terminated: ok {rc=0} 09:05:31.604208 --- ParallelTerminationStrategy: PID 18217 died... 09:05:31.623251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18217): Terminated: ok {rc=0} 09:05:31.708889 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:05:33.025194 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:33.032209 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:05:33.069137 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:05:33.110286 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:05:33.202761 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:05:33.236238 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:05:33.275585 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:05:33.876127 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:05:33.926971 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:33.938163 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:05:34.015208 tst cs_paging_gprs_active.py: using LAC 20395 09:05:34.144712 tst cs_paging_gprs_active.py: using RAC 250 09:05:34.272246 tst cs_paging_gprs_active.py: using CellId 20395 09:05:34.399463 tst cs_paging_gprs_active.py: using BVCI 20396 09:05:34.518862 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.530647 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.542271 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.554194 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.565975 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.577598 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.589282 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.600670 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:34.612523 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:05:34.732430 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:05:34.858802 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:05:35.080920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:35.409169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18222): Launched 09:05:35.694693 run iperf3-srv_10.42.42.10(pid=18223): Launched 09:05:35.817409 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:05:36.038300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:36.367049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18224): Launched 09:05:36.653906 run iperf3-srv_10.42.42.10(pid=18225): Launched 09:05:36.777773 tst cs_paging_gprs_active.py:38: start network... 09:05:36.999107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:37.509409 run create_hlr_db(pid=18226): Launched 09:05:37.634111 bus /gobi_6: Setting Powered False 09:05:38.698472 run create_hlr_db(pid=18226): Terminated: ok {rc=0} 09:05:39.136304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18228): Launched 09:05:39.443876 run osmo-hlr_10.42.42.2(pid=18229): Launched 09:05:39.560558 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:40.098177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18231): Launched 09:05:40.403369 run osmo-stp_10.42.42.5(pid=18232): Launched 09:05:40.519551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:41.047282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18234): Launched 09:05:41.163870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:41.424070 run patchelf(pid=18235): Launched 09:05:41.594252 run osmo-stp_10.42.42.5(pid=18232): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18232)] 09:05:41.723364 run osmo-stp_10.42.42.5(pid=18232): stdout: | (launched: 2022-12-09_09:05:40.346960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:41.853968 run osmo-stp_10.42.42.5(pid=18232): stderr: | [0;m[38;5;43m20221209090540514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090540514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090540514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090540515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090540515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090540515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090540515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:41.984822 run osmo-stp_10.42.42.5(pid=18232): stdout: | (launched: 2022-12-09_09:05:40.346960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:42.110197 run osmo-stp_10.42.42.5(pid=18232): stderr: | [0;m[38;5;43m20221209090540514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090540514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090540514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090540515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090540515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090540515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090540515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:42.258510 run patchelf(pid=18235): Terminating (SIGINT) 09:05:42.429700 run patchelf(pid=18235): Terminated: ok {rc=0} 09:05:42.553311 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18232): Process ended prematurely: osmo-stp_10.42.42.5(pid=18232) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18232)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:05:42.562716 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:05:42.590023 run osmo-hlr_10.42.42.2(pid=18229): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18229)] 09:05:42.637561 run osmo-hlr_10.42.42.2(pid=18229): stdout: | (launched: 2022-12-09_09:05:39.387421) 09:05:42.686849 run osmo-hlr_10.42.42.2(pid=18229): stderr: | [0;m[1;31m20221209090539563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090539563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090539563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090539563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090539563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090539563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090539575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090539586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090539586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090539586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:42.736492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18222): Terminating (SIGTERM) 09:05:42.776545 run iperf3-srv_10.42.42.10(pid=18223): Terminating (SIGTERM) 09:05:42.816374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18224): Terminating (SIGTERM) 09:05:42.856291 run iperf3-srv_10.42.42.10(pid=18225): Terminating (SIGTERM) 09:05:42.896049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18228): Terminating (SIGTERM) 09:05:42.936461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18231): Terminating (SIGTERM) 09:05:42.976662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18234): Terminating (SIGTERM) 09:05:43.016642 --- ParallelTerminationStrategy: PID 18222 died... 09:05:43.035838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18222): Terminated: ok {rc=0} 09:05:43.079880 --- ParallelTerminationStrategy: PID 18223 died... 09:05:43.098604 run iperf3-srv_10.42.42.10(pid=18223): Terminated {rc=256} 09:05:43.142497 --- ParallelTerminationStrategy: PID 18224 died... 09:05:43.161124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18224): Terminated: ok {rc=0} 09:05:43.205135 --- ParallelTerminationStrategy: PID 18225 died... 09:05:43.223763 run iperf3-srv_10.42.42.10(pid=18225): Terminated {rc=256} 09:05:43.267639 --- ParallelTerminationStrategy: PID 18228 died... 09:05:43.286355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18228): Terminated: ok {rc=0} 09:05:43.330312 --- ParallelTerminationStrategy: PID 18231 died... 09:05:43.349161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18231): Terminated: ok {rc=0} 09:05:43.393201 --- ParallelTerminationStrategy: PID 18234 died... 09:05:43.411931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18234): Terminated: ok {rc=0} 09:05:43.497420 bus /gobi_0: Setting Powered False 09:05:44.597772 bus /gobi_0: Setting Powered False 09:05:45.713012 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:05:46.867225 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:46.880592 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:05:46.956498 tst iperf3.py: using LAC 20396 09:05:47.089679 tst iperf3.py: using RAC 251 09:05:47.212053 tst iperf3.py: using CellId 20396 09:05:47.341215 tst iperf3.py: using BVCI 20397 09:05:47.458690 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.470373 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.481937 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.493460 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.504407 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.515720 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.527201 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.538287 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:47.549445 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:05:47.666386 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:05:47.872349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:48.177578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18236): Launched 09:05:48.442299 run iperf3-srv_10.42.42.10(pid=18237): Launched 09:05:48.558900 tst iperf3.py:8: start network... 09:05:48.763002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:49.238036 run create_hlr_db(pid=18238): Launched 09:05:49.362574 bus /gobi_6: Setting Powered False 09:05:50.423198 run create_hlr_db(pid=18238): Terminated: ok {rc=0} 09:05:50.845745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18240): Launched 09:05:51.150800 run osmo-hlr_10.42.42.2(pid=18241): Launched 09:05:51.266706 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:51.792262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18243): Launched 09:05:52.098436 run osmo-stp_10.42.42.5(pid=18244): Launched 09:05:52.215498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:52.743170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18246): Launched 09:05:52.859389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:53.118526 run patchelf(pid=18248): Launched 09:05:53.287971 run osmo-stp_10.42.42.5(pid=18244): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18244)] 09:05:53.416368 run osmo-stp_10.42.42.5(pid=18244): stdout: | (launched: 2022-12-09_09:05:52.041656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:53.546617 run osmo-stp_10.42.42.5(pid=18244): stderr: | [0;m[38;5;43m20221209090552213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090552213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090552214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090552214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090552215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090552215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090552215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:53.676587 run osmo-stp_10.42.42.5(pid=18244): stdout: | (launched: 2022-12-09_09:05:52.041656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:53.801372 run osmo-stp_10.42.42.5(pid=18244): stderr: | [0;m[38;5;43m20221209090552213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090552213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090552214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090552214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090552215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090552215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090552215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:53.949214 run patchelf(pid=18248): Terminating (SIGINT) 09:05:54.120125 run patchelf(pid=18248): Terminated: ok {rc=0} 09:05:54.243326 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18244): Process ended prematurely: osmo-stp_10.42.42.5(pid=18244) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18244)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 09:05:54.252850 tst iperf3.py:8: Test FAILED (7.4 sec) 09:05:54.279809 run osmo-hlr_10.42.42.2(pid=18241): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18241)] 09:05:54.327258 run osmo-hlr_10.42.42.2(pid=18241): stdout: | (launched: 2022-12-09_09:05:51.094755) 09:05:54.376931 run osmo-hlr_10.42.42.2(pid=18241): stderr: | [0;m[1;31m20221209090551269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090551269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090551269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090551269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090551269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090551269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090551282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090551291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090551291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090551291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:54.426665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18236): Terminating (SIGTERM) 09:05:54.466289 run iperf3-srv_10.42.42.10(pid=18237): Terminating (SIGTERM) 09:05:54.505781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18240): Terminating (SIGTERM) 09:05:54.545987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18243): Terminating (SIGTERM) 09:05:54.586008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18246): Terminating (SIGTERM) 09:05:54.626280 --- ParallelTerminationStrategy: PID 18236 died... 09:05:54.645408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18236): Terminated: ok {rc=0} 09:05:54.689741 --- ParallelTerminationStrategy: PID 18237 died... 09:05:54.708233 run iperf3-srv_10.42.42.10(pid=18237): Terminated {rc=256} 09:05:54.752577 --- ParallelTerminationStrategy: PID 18240 died... 09:05:54.771256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18240): Terminated: ok {rc=0} 09:05:54.815084 --- ParallelTerminationStrategy: PID 18243 died... 09:05:54.833802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18243): Terminated: ok {rc=0} 09:05:54.877390 --- ParallelTerminationStrategy: PID 18246 died... 09:05:54.896127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18246): Terminated: ok {rc=0} 09:05:54.981857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:05:56.129756 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.141759 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:05:56.212842 tst iperf3m4.py: using LAC 20397 09:05:56.332681 tst iperf3m4.py: using RAC 252 09:05:56.454240 tst iperf3m4.py: using CellId 20397 09:05:56.585028 tst iperf3m4.py: using BVCI 20398 09:05:56.703948 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.715651 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.727206 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.739787 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.751581 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.763642 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.775491 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.787218 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:05:56.799327 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:05:56.919027 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:05:57.041227 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:05:57.161228 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:05:57.283792 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:05:57.505593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:57.833362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18249): Launched 09:05:58.116762 run iperf3-srv_10.42.42.10(pid=18250): Launched 09:05:58.239393 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:05:58.460836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:58.789630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18251): Launched 09:05:59.072862 run iperf3-srv_10.42.42.10(pid=18252): Launched 09:05:59.195364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:05:59.415962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:05:59.744541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18253): Launched 09:06:00.028803 run iperf3-srv_10.42.42.10(pid=18254): Launched 09:06:00.151077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:06:00.371750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:00.700699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Launched 09:06:01.002003 run iperf3-srv_10.42.42.10(pid=18256): Launched 09:06:01.139574 tst iperf3m4.py:8: start network... 09:06:01.364821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:01.883736 run create_hlr_db(pid=18257): Launched 09:06:02.042593 bus /gobi_6: Setting Powered False 09:06:03.103750 run create_hlr_db(pid=18257): Terminated: ok {rc=0} 09:06:03.560391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18259): Launched 09:06:03.889175 run osmo-hlr_10.42.42.2(pid=18260): Launched 09:06:04.014609 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:04.580396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18262): Launched 09:06:04.906773 run osmo-stp_10.42.42.5(pid=18263): Launched 09:06:05.031263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:05.595651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18265): Launched 09:06:05.720219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:05.997286 run patchelf(pid=18266): Launched 09:06:06.178556 run osmo-stp_10.42.42.5(pid=18263): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18263)] 09:06:06.316713 run osmo-stp_10.42.42.5(pid=18263): stdout: | (launched: 2022-12-09_09:06:04.846764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:06.456410 run osmo-stp_10.42.42.5(pid=18263): stderr: | [0;m[38;5;43m20221209090605036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090605036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090605036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090605036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090605037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090605037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090605037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:06.596797 run osmo-stp_10.42.42.5(pid=18263): stdout: | (launched: 2022-12-09_09:06:04.846764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:06.730871 run osmo-stp_10.42.42.5(pid=18263): stderr: | [0;m[38;5;43m20221209090605036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090605036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090605036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090605036 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090605037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090605037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090605037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:06.889748 run patchelf(pid=18266): Terminating (SIGINT) 09:06:07.073125 run patchelf(pid=18266): Terminated: ok {rc=0} 09:06:07.205548 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18263): Process ended prematurely: osmo-stp_10.42.42.5(pid=18263) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18263)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:06:07.215841 tst iperf3m4.py:8: Test FAILED (11.1 sec) 09:06:07.245400 run osmo-hlr_10.42.42.2(pid=18260): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18260)] 09:06:07.296009 run osmo-hlr_10.42.42.2(pid=18260): stdout: | (launched: 2022-12-09_09:06:03.828687) 09:06:07.348751 run osmo-hlr_10.42.42.2(pid=18260): stderr: | [0;m[1;31m20221209090604026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090604026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090604027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090604027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090604027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090604027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090604040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090604048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090604048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090604048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:07.401944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18249): Terminating (SIGTERM) 09:06:07.444572 run iperf3-srv_10.42.42.10(pid=18250): Terminating (SIGTERM) 09:06:07.487268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18251): Terminating (SIGTERM) 09:06:07.529571 run iperf3-srv_10.42.42.10(pid=18252): Terminating (SIGTERM) 09:06:07.571651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18253): Terminating (SIGTERM) 09:06:07.613885 run iperf3-srv_10.42.42.10(pid=18254): Terminating (SIGTERM) 09:06:07.656072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Terminating (SIGTERM) 09:06:07.698654 run iperf3-srv_10.42.42.10(pid=18256): Terminating (SIGTERM) 09:06:07.740716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18259): Terminating (SIGTERM) 09:06:07.782856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18262): Terminating (SIGTERM) 09:06:07.825048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18265): Terminating (SIGTERM) 09:06:07.867548 --- ParallelTerminationStrategy: PID 18249 died... 09:06:07.887491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18249): Terminated: ok {rc=0} 09:06:07.934965 --- ParallelTerminationStrategy: PID 18250 died... 09:06:07.954667 run iperf3-srv_10.42.42.10(pid=18250): Terminated {rc=256} 09:06:08.001184 --- ParallelTerminationStrategy: PID 18251 died... 09:06:08.020538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18251): Terminated: ok {rc=0} 09:06:08.067147 --- ParallelTerminationStrategy: PID 18252 died... 09:06:08.086608 run iperf3-srv_10.42.42.10(pid=18252): Terminated {rc=256} 09:06:08.133175 --- ParallelTerminationStrategy: PID 18253 died... 09:06:08.152395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18253): Terminated: ok {rc=0} 09:06:08.198725 --- ParallelTerminationStrategy: PID 18254 died... 09:06:08.218276 run iperf3-srv_10.42.42.10(pid=18254): Terminated {rc=256} 09:06:08.264668 --- ParallelTerminationStrategy: PID 18255 died... 09:06:08.284257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18255): Terminated: ok {rc=0} 09:06:08.330644 --- ParallelTerminationStrategy: PID 18256 died... 09:06:08.350200 run iperf3-srv_10.42.42.10(pid=18256): Terminated {rc=256} 09:06:08.396460 --- ParallelTerminationStrategy: PID 18259 died... 09:06:08.415871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18259): Terminated: ok {rc=0} 09:06:08.462259 --- ParallelTerminationStrategy: PID 18262 died... 09:06:08.482038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18262): Terminated: ok {rc=0} 09:06:08.528761 --- ParallelTerminationStrategy: PID 18265 died... 09:06:08.549397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18265): Terminated: ok {rc=0} 09:06:08.637186 bus /gobi_4: Setting Powered False 09:06:09.736820 bus /gobi_4: Setting Powered False 09:06:10.853217 bus /gobi_1: Setting Powered False 09:06:11.951319 bus /gobi_1: Setting Powered False 09:06:13.066710 bus /gobi_0: Setting Powered False 09:06:14.162302 bus /gobi_0: Setting Powered False 09:06:15.277234 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:06:16.385893 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:16.398688 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:06:16.471721 tst ping.py: using LAC 20398 09:06:16.602248 tst ping.py: using RAC 253 09:06:16.743952 tst ping.py: using CellId 20398 09:06:16.862555 tst ping.py: using BVCI 20399 09:06:16.974068 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:16.985753 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:16.997167 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:17.008443 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:17.021463 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:17.033907 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:17.046443 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:17.059293 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:06:17.195637 tst ping.py:19: start network... 09:06:17.401606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:17.870133 run create_hlr_db(pid=18267): Launched 09:06:17.995570 bus /gobi_6: Setting Powered False 09:06:19.055414 run create_hlr_db(pid=18267): Terminated: ok {rc=0} 09:06:19.475509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18269): Launched 09:06:19.775143 run osmo-hlr_10.42.42.2(pid=18270): Launched 09:06:19.889087 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:20.421262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18272): Launched 09:06:20.721472 run osmo-stp_10.42.42.5(pid=18273): Launched 09:06:20.835651 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:21.352318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18275): Launched 09:06:21.466573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:21.719609 run patchelf(pid=18276): Launched 09:06:21.887591 run osmo-stp_10.42.42.5(pid=18273): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18273)] 09:06:22.016344 run osmo-stp_10.42.42.5(pid=18273): stdout: | (launched: 2022-12-09_09:06:20.665878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:22.144755 run osmo-stp_10.42.42.5(pid=18273): stderr: | [0;m[38;5;43m20221209090620833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090620833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090620833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090620834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090620834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090620834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090620834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:22.273580 run osmo-stp_10.42.42.5(pid=18273): stdout: | (launched: 2022-12-09_09:06:20.665878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:22.396672 run osmo-stp_10.42.42.5(pid=18273): stderr: | [0;m[38;5;43m20221209090620833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090620833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090620833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090620834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090620834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090620834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090620834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:22.542414 run patchelf(pid=18276): Terminating (SIGINT) 09:06:22.710290 run patchelf(pid=18276): Terminated: ok {rc=0} 09:06:22.831460 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18273): Process ended prematurely: osmo-stp_10.42.42.5(pid=18273) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18273)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 09:06:22.840237 tst ping.py:22: Test FAILED (6.4 sec) 09:06:22.866999 run osmo-hlr_10.42.42.2(pid=18270): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18270)] 09:06:22.915187 run osmo-hlr_10.42.42.2(pid=18270): stdout: | (launched: 2022-12-09_09:06:19.720105) 09:06:22.964221 run osmo-hlr_10.42.42.2(pid=18270): stderr: | [0;m[1;31m20221209090619893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090619893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090619893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090619893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090619893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090619893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090619905 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090619914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090619915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090619915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:23.013844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18269): Terminating (SIGTERM) 09:06:23.053743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18272): Terminating (SIGTERM) 09:06:23.093536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18275): Terminating (SIGTERM) 09:06:23.133630 --- ParallelTerminationStrategy: PID 18269 died... 09:06:23.152310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18269): Terminated: ok {rc=0} 09:06:23.196248 --- ParallelTerminationStrategy: PID 18272 died... 09:06:23.214778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18272): Terminated: ok {rc=0} 09:06:23.260112 --- ParallelTerminationStrategy: PID 18275 died... 09:06:23.278866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18275): Terminated: ok {rc=0} 09:06:23.361725 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:06:24.448648 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:24.461659 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:06:24.539448 tst ping_idle_ping.py: using LAC 20399 09:06:24.660804 tst ping_idle_ping.py: using RAC 254 09:06:24.780776 tst ping_idle_ping.py: using CellId 20399 09:06:24.900654 tst ping_idle_ping.py: using BVCI 20400 09:06:25.009924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:25.021007 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:25.032122 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:25.043190 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:25.054043 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:25.064833 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:25.075834 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:06:25.086816 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:06:25.207283 tst ping_idle_ping.py:24: start network... 09:06:25.424178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:25.924640 run create_hlr_db(pid=18279): Launched 09:06:26.049675 bus /gobi_6: Setting Powered False 09:06:27.113427 run create_hlr_db(pid=18279): Terminated: ok {rc=0} 09:06:27.546578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18281): Launched 09:06:27.850010 run osmo-hlr_10.42.42.2(pid=18282): Launched 09:06:27.964705 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:28.486248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18284): Launched 09:06:28.788882 run osmo-stp_10.42.42.5(pid=18285): Launched 09:06:28.904517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:29.425539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18287): Launched 09:06:29.540239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:29.794417 run patchelf(pid=18288): Launched 09:06:29.961521 run osmo-stp_10.42.42.5(pid=18285): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18285)] 09:06:30.089759 run osmo-stp_10.42.42.5(pid=18285): stdout: | (launched: 2022-12-09_09:06:28.732772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:30.219572 run osmo-stp_10.42.42.5(pid=18285): stderr: | [0;m[38;5;43m20221209090628901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090628902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090628902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090628902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090628903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090628903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090628903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:30.348908 run osmo-stp_10.42.42.5(pid=18285): stdout: | (launched: 2022-12-09_09:06:28.732772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:30.472860 run osmo-stp_10.42.42.5(pid=18285): stderr: | [0;m[38;5;43m20221209090628901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090628902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090628902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090628902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090628903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090628903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090628903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:30.619748 run patchelf(pid=18288): Terminating (SIGINT) 09:06:30.788526 run patchelf(pid=18288): Terminated: ok {rc=0} 09:06:30.911701 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18285): Process ended prematurely: osmo-stp_10.42.42.5(pid=18285) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18285)] [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:06:30.921236 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:06:30.948740 run osmo-hlr_10.42.42.2(pid=18282): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18282)] 09:06:30.997585 run osmo-hlr_10.42.42.2(pid=18282): stdout: | (launched: 2022-12-09_09:06:27.794415) 09:06:31.047515 run osmo-hlr_10.42.42.2(pid=18282): stderr: | [0;m[1;31m20221209090627970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090627970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090627970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090627970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090627970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090627970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090627983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090627991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090627992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090627992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:31.098551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18281): Terminating (SIGTERM) 09:06:31.139218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18284): Terminating (SIGTERM) 09:06:31.180205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18287): Terminating (SIGTERM) 09:06:31.223424 --- ParallelTerminationStrategy: PID 18281 died... 09:06:31.243167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18281): Terminated: ok {rc=0} 09:06:31.289743 --- ParallelTerminationStrategy: PID 18284 died... 09:06:31.309477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18284): Terminated: ok {rc=0} 09:06:31.354916 --- ParallelTerminationStrategy: PID 18287 died... 09:06:31.374307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18287): Terminated: ok {rc=0} 09:06:31.460091 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:06:32.778077 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:06:32.785655 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:06:32.818458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:06:32.857657 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:06:32.945393 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:06:32.978696 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:06:33.017952 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:06:33.631900 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:06:33.686167 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:33.698465 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:06:33.754222 tst cs_paging_gprs_active.py: using LAC 20400 09:06:33.886405 tst cs_paging_gprs_active.py: using RAC 255 09:06:34.013583 tst cs_paging_gprs_active.py: using CellId 20400 09:06:34.139453 tst cs_paging_gprs_active.py: using BVCI 20401 09:06:34.251622 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.263097 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.274403 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.285692 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.296927 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.308174 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.319494 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.330701 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:34.342229 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:06:34.462891 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:06:34.583179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:06:34.788260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:35.094797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18293): Launched 09:06:35.361222 run iperf3-srv_10.42.42.10(pid=18294): Launched 09:06:35.475898 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:06:35.681268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:35.988777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18295): Launched 09:06:36.255814 run iperf3-srv_10.42.42.10(pid=18296): Launched 09:06:36.370278 tst cs_paging_gprs_active.py:38: start network... 09:06:36.574870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:37.051260 run create_hlr_db(pid=18297): Launched 09:06:37.177084 bus /gobi_6: Setting Powered False 09:06:38.237957 run create_hlr_db(pid=18297): Terminated: ok {rc=0} 09:06:38.665914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18299): Launched 09:06:38.973704 run osmo-hlr_10.42.42.2(pid=18300): Launched 09:06:39.090319 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:39.632441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18302): Launched 09:06:39.938650 run osmo-stp_10.42.42.5(pid=18303): Launched 09:06:40.056786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:40.585915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18305): Launched 09:06:40.702281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:40.961075 run patchelf(pid=18306): Launched 09:06:41.130480 run osmo-stp_10.42.42.5(pid=18303): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18303)] 09:06:41.259303 run osmo-stp_10.42.42.5(pid=18303): stdout: | (launched: 2022-12-09_09:06:39.882391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:41.390220 run osmo-stp_10.42.42.5(pid=18303): stderr: | [0;m[38;5;43m20221209090640051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090640052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090640052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090640052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090640053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090640053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090640053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:41.520881 run osmo-stp_10.42.42.5(pid=18303): stdout: | (launched: 2022-12-09_09:06:39.882391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:41.646108 run osmo-stp_10.42.42.5(pid=18303): stderr: | [0;m[38;5;43m20221209090640051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090640052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090640052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090640052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090640053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090640053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090640053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:41.793655 run patchelf(pid=18306): Terminating (SIGINT) 09:06:41.964433 run patchelf(pid=18306): Terminated: ok {rc=0} 09:06:42.087382 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18303): Process ended prematurely: osmo-stp_10.42.42.5(pid=18303) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18303)] [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:06:42.096927 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:06:42.124076 run osmo-hlr_10.42.42.2(pid=18300): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18300)] 09:06:42.172208 run osmo-hlr_10.42.42.2(pid=18300): stdout: | (launched: 2022-12-09_09:06:38.916682) 09:06:42.221576 run osmo-hlr_10.42.42.2(pid=18300): stderr: | [0;m[1;31m20221209090639091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090639091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090639091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090639091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090639091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090639091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090639103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090639114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090639114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090639114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:42.271674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18293): Terminating (SIGTERM) 09:06:42.311287 run iperf3-srv_10.42.42.10(pid=18294): Terminating (SIGTERM) 09:06:42.350793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18295): Terminating (SIGTERM) 09:06:42.390339 run iperf3-srv_10.42.42.10(pid=18296): Terminating (SIGTERM) 09:06:42.429707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18299): Terminating (SIGTERM) 09:06:42.469248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18302): Terminating (SIGTERM) 09:06:42.508567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18305): Terminating (SIGTERM) 09:06:42.548279 --- ParallelTerminationStrategy: PID 18293 died... 09:06:42.567154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18293): Terminated: ok {rc=0} 09:06:42.611018 --- ParallelTerminationStrategy: PID 18294 died... 09:06:42.629467 run iperf3-srv_10.42.42.10(pid=18294): Terminated {rc=256} 09:06:42.672782 --- ParallelTerminationStrategy: PID 18295 died... 09:06:42.691238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18295): Terminated: ok {rc=0} 09:06:42.734663 --- ParallelTerminationStrategy: PID 18296 died... 09:06:42.753096 run iperf3-srv_10.42.42.10(pid=18296): Terminated {rc=256} 09:06:42.796341 --- ParallelTerminationStrategy: PID 18299 died... 09:06:42.814793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18299): Terminated: ok {rc=0} 09:06:42.858630 --- ParallelTerminationStrategy: PID 18302 died... 09:06:42.877108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18302): Terminated: ok {rc=0} 09:06:42.920682 --- ParallelTerminationStrategy: PID 18305 died... 09:06:42.939240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18305): Terminated: ok {rc=0} 09:06:43.024180 bus /gobi_0: Setting Powered False 09:06:44.122887 bus /gobi_0: Setting Powered False 09:06:45.235089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:06:46.377158 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:46.389840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:06:46.446957 tst iperf3.py: using LAC 20401 09:06:46.615172 tst iperf3.py: using RAC 1 09:06:46.785632 tst iperf3.py: using CellId 20401 09:06:46.935609 tst iperf3.py: using BVCI 20402 09:06:47.083053 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.095837 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.108778 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.121847 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.135906 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.151737 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.165886 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.179812 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:47.193962 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:06:47.318956 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:06:47.542334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:47.871305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18307): Launched 09:06:48.156214 run iperf3-srv_10.42.42.10(pid=18308): Launched 09:06:48.278824 tst iperf3.py:8: start network... 09:06:48.500193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:49.008582 run create_hlr_db(pid=18309): Launched 09:06:49.133538 bus /gobi_6: Setting Powered False 09:06:50.193641 run create_hlr_db(pid=18309): Terminated: ok {rc=0} 09:06:50.648582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Launched 09:06:50.978071 run osmo-hlr_10.42.42.2(pid=18312): Launched 09:06:51.102926 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:51.662732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Launched 09:06:51.990698 run osmo-stp_10.42.42.5(pid=18315): Launched 09:06:52.115722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:06:52.681655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18317): Launched 09:06:52.806395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:06:53.083443 run patchelf(pid=18318): Launched 09:06:53.264490 run osmo-stp_10.42.42.5(pid=18315): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] 09:06:53.402575 run osmo-stp_10.42.42.5(pid=18315): stdout: | (launched: 2022-12-09_09:06:51.930932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:53.543227 run osmo-stp_10.42.42.5(pid=18315): stderr: | [0;m[38;5;43m20221209090652118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090652118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090652118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090652119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090652119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090652119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090652119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:53.683406 run osmo-stp_10.42.42.5(pid=18315): stdout: | (launched: 2022-12-09_09:06:51.930932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:53.817622 run osmo-stp_10.42.42.5(pid=18315): stderr: | [0;m[38;5;43m20221209090652118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090652118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090652118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090652119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090652119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090652119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090652119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:53.976242 run patchelf(pid=18318): Terminating (SIGINT) 09:06:54.160002 run patchelf(pid=18318): Terminated: ok {rc=0} 09:06:54.292226 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18315): Process ended prematurely: osmo-stp_10.42.42.5(pid=18315) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:06:54.302542 tst iperf3.py:8: Test FAILED (8.0 sec) 09:06:54.331464 run osmo-hlr_10.42.42.2(pid=18312): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18312)] 09:06:54.382451 run osmo-hlr_10.42.42.2(pid=18312): stdout: | (launched: 2022-12-09_09:06:50.917966) 09:06:54.434558 run osmo-hlr_10.42.42.2(pid=18312): stderr: | [0;m[1;31m20221209090651114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090651114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090651114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090651114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090651114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090651114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090651126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090651134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090651135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090651135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:54.487148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18307): Terminating (SIGTERM) 09:06:54.529641 run iperf3-srv_10.42.42.10(pid=18308): Terminating (SIGTERM) 09:06:54.571705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminating (SIGTERM) 09:06:54.614007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Terminating (SIGTERM) 09:06:54.656141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18317): Terminating (SIGTERM) 09:06:54.698418 --- ParallelTerminationStrategy: PID 18307 died... 09:06:54.718477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18307): Terminated: ok {rc=0} 09:06:54.765071 --- ParallelTerminationStrategy: PID 18308 died... 09:06:54.784464 run iperf3-srv_10.42.42.10(pid=18308): Terminated {rc=256} 09:06:54.830760 --- ParallelTerminationStrategy: PID 18311 died... 09:06:54.850281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminated: ok {rc=0} 09:06:54.896477 --- ParallelTerminationStrategy: PID 18314 died... 09:06:54.915901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Terminated: ok {rc=0} 09:06:54.962253 --- ParallelTerminationStrategy: PID 18317 died... 09:06:54.981974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18317): Terminated: ok {rc=0} 09:06:55.070344 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:06:56.221555 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.234294 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:06:56.287259 tst iperf3m4.py: using LAC 20402 09:06:56.415414 tst iperf3m4.py: using RAC 2 09:06:56.542501 tst iperf3m4.py: using CellId 20402 09:06:56.665450 tst iperf3m4.py: using BVCI 20403 09:06:56.778308 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.790001 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.801433 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.812916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.824366 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.836633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.848095 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.859333 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:06:56.870796 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:06:56.992168 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:06:57.113794 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:06:57.234922 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:06:57.359903 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:06:57.582941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:57.912035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18319): Launched 09:06:58.198534 run iperf3-srv_10.42.42.10(pid=18320): Launched 09:06:58.323048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:06:58.543961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:58.873238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18321): Launched 09:06:59.159055 run iperf3-srv_10.42.42.10(pid=18322): Launched 09:06:59.281878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:06:59.503353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:06:59.833183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18323): Launched 09:07:00.117558 run iperf3-srv_10.42.42.10(pid=18324): Launched 09:07:00.241539 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:07:00.462104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:07:00.791624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18325): Launched 09:07:01.104321 run iperf3-srv_10.42.42.10(pid=18326): Launched 09:07:01.239987 tst iperf3m4.py:8: start network... 09:07:01.465657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:02.024572 run create_hlr_db(pid=18327): Launched 09:07:02.189126 bus /gobi_6: Setting Powered False 09:07:03.253733 run create_hlr_db(pid=18327): Terminated: ok {rc=0} 09:07:03.692189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Launched 09:07:04.000433 run osmo-hlr_10.42.42.2(pid=18330): Launched 09:07:04.117558 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:04.645543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18332): Launched 09:07:04.950528 run osmo-stp_10.42.42.5(pid=18333): Launched 09:07:05.070328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:05.600897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18335): Launched 09:07:05.718095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:05.976073 run patchelf(pid=18336): Launched 09:07:06.145627 run osmo-stp_10.42.42.5(pid=18333): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18333)] 09:07:06.274265 run osmo-stp_10.42.42.5(pid=18333): stdout: | (launched: 2022-12-09_09:07:04.893857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:06.404486 run osmo-stp_10.42.42.5(pid=18333): stderr: | [0;m[38;5;43m20221209090705060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090705060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090705060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090705061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090705061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090705061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090705061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:06.534857 run osmo-stp_10.42.42.5(pid=18333): stdout: | (launched: 2022-12-09_09:07:04.893857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:06.659684 run osmo-stp_10.42.42.5(pid=18333): stderr: | [0;m[38;5;43m20221209090705060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090705060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090705060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090705061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090705061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090705061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090705061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:06.807800 run patchelf(pid=18336): Terminating (SIGINT) 09:07:06.979429 run patchelf(pid=18336): Terminated: ok {rc=0} 09:07:07.102529 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18333): Process ended prematurely: osmo-stp_10.42.42.5(pid=18333) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18333)] [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:07:07.112003 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:07:07.139613 run osmo-hlr_10.42.42.2(pid=18330): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18330)] 09:07:07.187189 run osmo-hlr_10.42.42.2(pid=18330): stdout: | (launched: 2022-12-09_09:07:03.943628) 09:07:07.236160 run osmo-hlr_10.42.42.2(pid=18330): stderr: | [0;m[1;31m20221209090704117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090704117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090704117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090704117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090704117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090704117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090704134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090704145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090704146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090704146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:07.285614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18319): Terminating (SIGTERM) 09:07:07.325452 run iperf3-srv_10.42.42.10(pid=18320): Terminating (SIGTERM) 09:07:07.364934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18321): Terminating (SIGTERM) 09:07:07.404476 run iperf3-srv_10.42.42.10(pid=18322): Terminating (SIGTERM) 09:07:07.443728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18323): Terminating (SIGTERM) 09:07:07.483278 run iperf3-srv_10.42.42.10(pid=18324): Terminating (SIGTERM) 09:07:07.522620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18325): Terminating (SIGTERM) 09:07:07.561975 run iperf3-srv_10.42.42.10(pid=18326): Terminating (SIGTERM) 09:07:07.601502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Terminating (SIGTERM) 09:07:07.641179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18332): Terminating (SIGTERM) 09:07:07.680453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18335): Terminating (SIGTERM) 09:07:07.720177 --- ParallelTerminationStrategy: PID 18319 died... 09:07:07.739184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18319): Terminated: ok {rc=0} 09:07:07.782783 --- ParallelTerminationStrategy: PID 18320 died... 09:07:07.801193 run iperf3-srv_10.42.42.10(pid=18320): Terminated {rc=256} 09:07:07.844640 --- ParallelTerminationStrategy: PID 18321 died... 09:07:07.863190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18321): Terminated: ok {rc=0} 09:07:07.906719 --- ParallelTerminationStrategy: PID 18322 died... 09:07:07.925196 run iperf3-srv_10.42.42.10(pid=18322): Terminated {rc=256} 09:07:07.969096 --- ParallelTerminationStrategy: PID 18323 died... 09:07:07.987517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18323): Terminated: ok {rc=0} 09:07:08.030991 --- ParallelTerminationStrategy: PID 18324 died... 09:07:08.049425 run iperf3-srv_10.42.42.10(pid=18324): Terminated {rc=256} 09:07:08.092764 --- ParallelTerminationStrategy: PID 18325 died... 09:07:08.111482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18325): Terminated: ok {rc=0} 09:07:08.155015 --- ParallelTerminationStrategy: PID 18326 died... 09:07:08.173502 run iperf3-srv_10.42.42.10(pid=18326): Terminated {rc=256} 09:07:08.217449 --- ParallelTerminationStrategy: PID 18329 died... 09:07:08.235907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Terminated: ok {rc=0} 09:07:08.280070 --- ParallelTerminationStrategy: PID 18332 died... 09:07:08.298587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18332): Terminated: ok {rc=0} 09:07:08.342176 --- ParallelTerminationStrategy: PID 18335 died... 09:07:08.360754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18335): Terminated: ok {rc=0} 09:07:08.446886 bus /gobi_4: Setting Powered False 09:07:09.546824 bus /gobi_4: Setting Powered False 09:07:10.661707 bus /gobi_1: Setting Powered False 09:07:11.760628 bus /gobi_1: Setting Powered False 09:07:12.876125 bus /gobi_0: Setting Powered False 09:07:13.974423 bus /gobi_0: Setting Powered False 09:07:15.090762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:07:16.201452 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.216052 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:07:16.273741 tst ping.py: using LAC 20403 09:07:16.419663 tst ping.py: using RAC 3 09:07:16.595616 tst ping.py: using CellId 20403 09:07:16.739367 tst ping.py: using BVCI 20404 09:07:16.860343 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.873513 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.887368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.901349 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.915258 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.928112 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.944260 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:16.958177 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:07:17.081711 tst ping.py:19: start network... 09:07:17.324028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:17.823055 run create_hlr_db(pid=18337): Launched 09:07:17.945628 bus /gobi_6: Setting Powered False 09:07:19.008852 run create_hlr_db(pid=18337): Terminated: ok {rc=0} 09:07:19.438009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18339): Launched 09:07:19.738493 run osmo-hlr_10.42.42.2(pid=18340): Launched 09:07:19.852096 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:20.383242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18342): Launched 09:07:20.684463 run osmo-stp_10.42.42.5(pid=18343): Launched 09:07:20.799100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:21.320203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18345): Launched 09:07:21.434851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:21.689244 run patchelf(pid=18346): Launched 09:07:21.857054 run osmo-stp_10.42.42.5(pid=18343): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18343)] 09:07:21.984103 run osmo-stp_10.42.42.5(pid=18343): stdout: | (launched: 2022-12-09_09:07:20.628252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:22.113167 run osmo-stp_10.42.42.5(pid=18343): stderr: | [0;m[38;5;43m20221209090720797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090720797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090720798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090720798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090720799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090720799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090720799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:22.241581 run osmo-stp_10.42.42.5(pid=18343): stdout: | (launched: 2022-12-09_09:07:20.628252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:22.365078 run osmo-stp_10.42.42.5(pid=18343): stderr: | [0;m[38;5;43m20221209090720797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090720797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090720798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090720798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090720799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090720799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090720799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:22.510811 run patchelf(pid=18346): Terminating (SIGINT) 09:07:22.679542 run patchelf(pid=18346): Terminated: ok {rc=0} 09:07:22.800855 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18343): Process ended prematurely: osmo-stp_10.42.42.5(pid=18343) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18343)] [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:07:22.809870 tst ping.py:22: Test FAILED (6.6 sec) 09:07:22.836494 run osmo-hlr_10.42.42.2(pid=18340): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18340)] 09:07:22.883787 run osmo-hlr_10.42.42.2(pid=18340): stdout: | (launched: 2022-12-09_09:07:19.682508) 09:07:22.932761 run osmo-hlr_10.42.42.2(pid=18340): stderr: | [0;m[1;31m20221209090719859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090719859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090719859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090719859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090719859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090719859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090719871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090719882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090719883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090719883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:22.982345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18339): Terminating (SIGTERM) 09:07:23.022068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18342): Terminating (SIGTERM) 09:07:23.061778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18345): Terminating (SIGTERM) 09:07:23.101749 --- ParallelTerminationStrategy: PID 18339 died... 09:07:23.120898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18339): Terminated: ok {rc=0} 09:07:23.164807 --- ParallelTerminationStrategy: PID 18342 died... 09:07:23.183675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18342): Terminated: ok {rc=0} 09:07:23.227310 --- ParallelTerminationStrategy: PID 18345 died... 09:07:23.246049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18345): Terminated: ok {rc=0} 09:07:23.331545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:07:24.420491 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:24.432757 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:07:24.485914 tst ping_idle_ping.py: using LAC 20404 09:07:24.605400 tst ping_idle_ping.py: using RAC 4 09:07:24.732476 tst ping_idle_ping.py: using CellId 20404 09:07:24.863367 tst ping_idle_ping.py: using BVCI 20405 09:07:24.981589 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:24.993854 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:25.005920 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:25.018286 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:25.030561 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:25.042918 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:25.055707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:07:25.068258 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:07:25.186350 tst ping_idle_ping.py:24: start network... 09:07:25.387774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:25.858478 run create_hlr_db(pid=18347): Launched 09:07:25.984611 bus /gobi_6: Setting Powered False 09:07:27.045386 run create_hlr_db(pid=18347): Terminated: ok {rc=0} 09:07:27.487015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18349): Launched 09:07:27.810567 run osmo-hlr_10.42.42.2(pid=18350): Launched 09:07:27.934302 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:28.489102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18352): Launched 09:07:28.811791 run osmo-stp_10.42.42.5(pid=18353): Launched 09:07:28.935117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:29.491092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18355): Launched 09:07:29.616234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:29.888686 run patchelf(pid=18356): Launched 09:07:30.066843 run osmo-stp_10.42.42.5(pid=18353): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18353)] 09:07:30.202934 run osmo-stp_10.42.42.5(pid=18353): stdout: | (launched: 2022-12-09_09:07:28.752676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:30.340923 run osmo-stp_10.42.42.5(pid=18353): stderr: | [0;m[38;5;43m20221209090728942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090728943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090728944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090728944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090728945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090728945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090728945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:30.478806 run osmo-stp_10.42.42.5(pid=18353): stdout: | (launched: 2022-12-09_09:07:28.752676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:30.611396 run osmo-stp_10.42.42.5(pid=18353): stderr: | [0;m[38;5;43m20221209090728942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090728943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090728944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090728944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090728945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090728945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090728945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:30.767580 run patchelf(pid=18356): Terminating (SIGINT) 09:07:30.987666 run patchelf(pid=18356): Terminated: ok {rc=0} 09:07:31.132142 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18353): Process ended prematurely: osmo-stp_10.42.42.5(pid=18353) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18353)] [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:07:31.142477 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:07:31.171764 run osmo-hlr_10.42.42.2(pid=18350): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18350)] 09:07:31.223226 run osmo-hlr_10.42.42.2(pid=18350): stdout: | (launched: 2022-12-09_09:07:27.751317) 09:07:31.276098 run osmo-hlr_10.42.42.2(pid=18350): stderr: | [0;m[1;31m20221209090727947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090727947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090727947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090727947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090727947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090727947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090727959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090727968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090727968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090727968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:31.329705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18349): Terminating (SIGTERM) 09:07:31.373139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18352): Terminating (SIGTERM) 09:07:31.416848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18355): Terminating (SIGTERM) 09:07:31.461680 --- ParallelTerminationStrategy: PID 18349 died... 09:07:31.482098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18349): Terminated: ok {rc=0} 09:07:31.530313 --- ParallelTerminationStrategy: PID 18352 died... 09:07:31.550505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18352): Terminated: ok {rc=0} 09:07:31.598527 --- ParallelTerminationStrategy: PID 18355 died... 09:07:31.618848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18355): Terminated: ok {rc=0} 09:07:31.708479 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:07:33.023707 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:33.030677 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:07:33.064470 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:07:33.099795 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:07:33.153212 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:07:33.186537 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:07:33.221952 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:07:33.787888 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:07:33.793288 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:33.805176 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:07:33.875014 tst switch_tch_pdch.py: using LAC 20405 09:07:33.992907 tst switch_tch_pdch.py: using RAC 5 09:07:34.110462 tst switch_tch_pdch.py: using CellId 20405 09:07:34.229348 tst switch_tch_pdch.py: using BVCI 20406 09:07:34.337786 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:34.349414 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:34.360413 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:34.371759 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:34.382991 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:34.394218 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:34.405647 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:07:34.416994 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:07:34.532646 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:07:34.651612 tst switch_tch_pdch.py:51: start network... 09:07:34.851740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:35.315988 run create_hlr_db(pid=18360): Launched 09:07:35.440682 bus /gobi_6: Setting Powered False 09:07:36.500251 run create_hlr_db(pid=18360): Terminated: ok {rc=0} 09:07:36.940342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18363): Launched 09:07:37.261968 run osmo-hlr_10.42.42.2(pid=18364): Launched 09:07:37.384424 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:37.939881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18366): Launched 09:07:38.260386 run osmo-stp_10.42.42.5(pid=18367): Launched 09:07:38.382627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:38.940009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18369): Launched 09:07:39.064653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:39.335978 run patchelf(pid=18370): Launched 09:07:39.514532 run osmo-stp_10.42.42.5(pid=18367): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18367)] 09:07:39.650216 run osmo-stp_10.42.42.5(pid=18367): stdout: | (launched: 2022-12-09_09:07:38.201740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:39.787461 run osmo-stp_10.42.42.5(pid=18367): stderr: | [0;m[38;5;43m20221209090738389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090738389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090738389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090738389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090738390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090738390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090738390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:39.925139 run osmo-stp_10.42.42.5(pid=18367): stdout: | (launched: 2022-12-09_09:07:38.201740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:40.057325 run osmo-stp_10.42.42.5(pid=18367): stderr: | [0;m[38;5;43m20221209090738389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090738389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090738389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090738389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090738390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090738390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090738390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:40.213217 run patchelf(pid=18370): Terminating (SIGINT) 09:07:40.392225 run patchelf(pid=18370): Terminated: ok {rc=0} 09:07:40.522295 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18367): Process ended prematurely: osmo-stp_10.42.42.5(pid=18367) [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18367)] [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:07:40.531805 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:07:40.560324 run osmo-hlr_10.42.42.2(pid=18364): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18364)] 09:07:40.610640 run osmo-hlr_10.42.42.2(pid=18364): stdout: | (launched: 2022-12-09_09:07:37.203221) 09:07:40.662682 run osmo-hlr_10.42.42.2(pid=18364): stderr: | [0;m[1;31m20221209090737399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090737399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090737399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090737399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090737399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090737399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090737416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090737425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090737425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090737425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:40.715277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18363): Terminating (SIGTERM) 09:07:40.757122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18366): Terminating (SIGTERM) 09:07:40.799162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18369): Terminating (SIGTERM) 09:07:40.842406 --- ParallelTerminationStrategy: PID 18363 died... 09:07:40.862719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18363): Terminated: ok {rc=0} 09:07:40.909209 --- ParallelTerminationStrategy: PID 18366 died... 09:07:40.928528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18366): Terminated: ok {rc=0} 09:07:40.974716 --- ParallelTerminationStrategy: PID 18369 died... 09:07:40.994161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18369): Terminated: ok {rc=0} 09:07:41.081252 bus /gobi_0: Setting Powered False 09:07:42.180145 bus /gobi_0: Setting Powered False 09:07:43.297103 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:07:44.559475 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:44.565825 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:07:44.600555 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:07:44.637053 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:07:44.695011 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:07:44.728471 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:07:44.763642 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:07:45.321213 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:07:45.326570 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:45.338240 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:07:45.410017 tst switch_tch_pdch.py: using LAC 20406 09:07:45.536881 tst switch_tch_pdch.py: using RAC 6 09:07:45.661844 tst switch_tch_pdch.py: using CellId 20406 09:07:45.789112 tst switch_tch_pdch.py: using BVCI 20407 09:07:45.934294 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:45.946787 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:45.959077 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:45.972519 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:45.984901 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:45.998434 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:46.011623 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:07:46.024000 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:07:46.146097 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:07:46.263512 tst switch_tch_pdch.py:51: start network... 09:07:46.487568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:46.966452 run create_hlr_db(pid=18374): Launched 09:07:47.126428 bus /gobi_6: Setting Powered False 09:07:48.189996 run create_hlr_db(pid=18374): Terminated: ok {rc=0} 09:07:48.593966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18376): Launched 09:07:48.894123 run osmo-hlr_10.42.42.2(pid=18377): Launched 09:07:49.008082 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:49.513330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18379): Launched 09:07:49.814238 run osmo-stp_10.42.42.5(pid=18380): Launched 09:07:49.928045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:07:50.436107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18382): Launched 09:07:50.551326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:07:50.805887 run patchelf(pid=18383): Launched 09:07:50.972791 run osmo-stp_10.42.42.5(pid=18380): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18380)] 09:07:51.100192 run osmo-stp_10.42.42.5(pid=18380): stdout: | (launched: 2022-12-09_09:07:49.758434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:51.229431 run osmo-stp_10.42.42.5(pid=18380): stderr: | [0;m[38;5;43m20221209090749927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090749927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090749927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090749928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090749928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090749928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090749928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:51.358583 run osmo-stp_10.42.42.5(pid=18380): stdout: | (launched: 2022-12-09_09:07:49.758434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:51.482239 run osmo-stp_10.42.42.5(pid=18380): stderr: | [0;m[38;5;43m20221209090749927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090749927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090749927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090749928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090749928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090749928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090749928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:51.628908 run patchelf(pid=18383): Terminating (SIGINT) 09:07:51.797249 run patchelf(pid=18383): Terminated: ok {rc=0} 09:07:51.918795 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18380): Process ended prematurely: osmo-stp_10.42.42.5(pid=18380) [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18380)] [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:07:51.927937 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:07:51.958826 run osmo-hlr_10.42.42.2(pid=18377): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18377)] 09:07:52.010585 run osmo-hlr_10.42.42.2(pid=18377): stdout: | (launched: 2022-12-09_09:07:48.838953) 09:07:52.063031 run osmo-hlr_10.42.42.2(pid=18377): stderr: | [0;m[1;31m20221209090749014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090749014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090749014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090749014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090749014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090749014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090749028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090749038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090749039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090749039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:52.116037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18376): Terminating (SIGTERM) 09:07:52.158171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18379): Terminating (SIGTERM) 09:07:52.200334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18382): Terminating (SIGTERM) 09:07:52.242922 --- ParallelTerminationStrategy: PID 18376 died... 09:07:52.262957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18376): Terminated: ok {rc=0} 09:07:52.310322 --- ParallelTerminationStrategy: PID 18379 died... 09:07:52.329911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18379): Terminated: ok {rc=0} 09:07:52.376802 --- ParallelTerminationStrategy: PID 18382 died... 09:07:52.396870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18382): Terminated: ok {rc=0} 09:07:52.487861 bus /gobi_0: Setting Powered False 09:07:53.586485 bus /gobi_0: Setting Powered False 09:07:54.704342 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_sms:trx-lms --------------------------------------------------------------------- 09:07:55.957748 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:55.961969 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:07:55.997015 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:07:56.004094 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:07:56.057579 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:07:56.091860 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:07:56.098806 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:07:56.636494 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:07:56.641861 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 09:07:56.652784 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 09:07:56.700996 tst mo_mt_sms.py: using LAC 20407 09:07:56.818245 tst mo_mt_sms.py: using RAC 7 09:07:56.942162 tst mo_mt_sms.py: using CellId 20407 09:07:57.059960 tst mo_mt_sms.py: using BVCI 20408 09:07:57.169804 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:07:57.284502 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:07:57.401646 tst mo_mt_sms.py:9: start nitb and bts... 09:07:57.619538 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:07:58.272205 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18387): Launched 09:07:58.592524 run osmo-nitb_10.42.42.2(pid=18388): Launched 09:07:58.771888 run osmo-nitb_10.42.42.2(pid=18388): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18388)] 09:07:58.915089 run osmo-nitb_10.42.42.2(pid=18388): stdout: | (launched: 2022-12-09_09:07:58.533938) 09:07:59.060424 run osmo-nitb_10.42.42.2(pid=18388): stderr: | (launched: 2022-12-09_09:07:58.582016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:07:59.205471 run osmo-nitb_10.42.42.2(pid=18388): stdout: | (launched: 2022-12-09_09:07:58.533938) 09:07:59.345319 run osmo-nitb_10.42.42.2(pid=18388): stderr: | (launched: 2022-12-09_09:07:58.582016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18388): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18388) [trial-2357↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18388)] 09:07:59.714994 tst osmo-nitb_10.42.42.2(pid=18388): stdout: | (launched: 2022-12-09_09:07:58.533938) 09:07:59.844832 tst osmo-nitb_10.42.42.2(pid=18388): stderr: | (launched: 2022-12-09_09:07:58.582016) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:07:59.997742 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18388): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18388) [trial-2357↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18388)] [trial-2357↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 09:08:00.006858 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:08:00.014111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18387): Terminating (SIGTERM) 09:08:00.227164 --- ParallelTerminationStrategy: PID 18387 died... 09:08:00.248440 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18387): Terminated: ok {rc=0} 09:08:00.336334 bus /sierra_3: Setting Powered False 09:08:01.439331 bus /sierra_3: Setting Powered False 09:08:02.579210 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:trx-lms --------------------------------------------------------------------- 09:08:03.791013 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:03.795752 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:08:03.830772 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:08:03.859706 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:08:03.911775 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:08:03.949498 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:08:03.977956 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:08:04.519345 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:08:04.526494 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:04.538747 tst sms:trx-lms: Using 1 x bts (candidates: 1) 09:08:04.593965 tst mo_mt_sms.py: using LAC 20408 09:08:04.723256 tst mo_mt_sms.py: using RAC 8 09:08:04.850167 tst mo_mt_sms.py: using CellId 20408 09:08:04.980372 tst mo_mt_sms.py: using BVCI 20409 09:08:05.100006 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:05.112349 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:05.124585 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:05.137591 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:05.151556 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:05.163691 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:08:05.288182 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:08:05.413962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:05.916324 run create_hlr_db(pid=18663): Launched 09:08:06.081864 bus /sierra_2: Setting Powered False 09:08:07.142080 run create_hlr_db(pid=18663): Terminated: ok {rc=0} 09:08:07.571129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18665): Launched 09:08:07.904498 run osmo-hlr_10.42.42.2(pid=18666): Launched 09:08:08.152389 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:08.810359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18668): Launched 09:08:09.147250 run osmo-stp_10.42.42.5(pid=18669): Launched 09:08:09.389663 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:10.090141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18671): Launched 09:08:10.414051 run osmo-msc_10.42.42.6(pid=18672): Launched 09:08:10.770734 run osmo-stp_10.42.42.5(pid=18669): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18669)] 09:08:11.038745 run osmo-stp_10.42.42.5(pid=18669): stdout: | (launched: 2022-12-09_09:08:09.087465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:11.310654 run osmo-stp_10.42.42.5(pid=18669): stderr: | [0;m[38;5;43m20221209090809409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090809409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090809409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090809410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090809410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090809410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090809410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:11.467210 run osmo-stp_10.42.42.5(pid=18669): stdout: | (launched: 2022-12-09_09:08:09.087465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:11.592067 run osmo-stp_10.42.42.5(pid=18669): stderr: | [0;m[38;5;43m20221209090809409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090809409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090809409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090809410 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090809410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090809410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090809410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:11.740210 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18669): Process ended prematurely: osmo-stp_10.42.42.5(pid=18669) [trial-2357↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18669)] [trial-2357↪sms:trx-lms↪mo_mt_sms.py:16] 09:08:11.749615 tst mo_mt_sms.py:16: Test FAILED (7.2 sec) 09:08:11.777079 run osmo-hlr_10.42.42.2(pid=18666): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18666)] 09:08:11.827003 run osmo-hlr_10.42.42.2(pid=18666): stdout: | (launched: 2022-12-09_09:08:07.845988) 09:08:11.878809 run osmo-hlr_10.42.42.2(pid=18666): stderr: | [0;m[1;31m20221209090808148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090808148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090808148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090808148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090808148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090808148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090808163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090808180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090808180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090808180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:11.949951 run osmo-msc_10.42.42.6(pid=18672): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18672)] 09:08:12.000923 run osmo-msc_10.42.42.6(pid=18672): stdout: | (launched: 2022-12-09_09:08:10.355223) 09:08:12.051937 run osmo-msc_10.42.42.6(pid=18672): stderr: | [0;m[38;5;43m20221209090810944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090810944 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8190443c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090810953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090810953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090810954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090810954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090810956 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090810956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090810956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090810956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:12.103423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18665): Terminating (SIGTERM) 09:08:12.146531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18668): Terminating (SIGTERM) 09:08:12.189767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18671): Terminating (SIGTERM) 09:08:12.232543 --- ParallelTerminationStrategy: PID 18665 died... 09:08:12.252653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18665): Terminated: ok {rc=0} 09:08:12.299751 --- ParallelTerminationStrategy: PID 18668 died... 09:08:12.319281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18668): Terminated: ok {rc=0} 09:08:12.364873 --- ParallelTerminationStrategy: PID 18671 died... 09:08:12.384525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18671): Terminated: ok {rc=0} 09:08:12.471592 bus /sierra_3: Setting Powered False 09:08:13.572544 bus /sierra_3: Setting Powered False 09:08:14.688994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-lms --------------------------------------------------------------------- 09:08:15.973872 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:15.977984 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:08:16.030302 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:08:16.038307 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:08:16.082776 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:08:16.147588 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:08:16.160674 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:08:16.666371 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 09:08:16.672207 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 09:08:16.688071 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 09:08:16.755279 tst assert_extension.py: using LAC 20409 09:08:16.923306 tst assert_extension.py: using RAC 9 09:08:17.056892 tst assert_extension.py: using CellId 20409 09:08:17.187264 tst assert_extension.py: using BVCI 20410 09:08:17.299879 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 09:08:17.441376 tst assert_extension.py:10: start nitb and bts... 09:08:17.673546 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:08:18.327318 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18677): Launched 09:08:18.667398 run osmo-nitb_10.42.42.2(pid=18678): Launched 09:08:18.868674 run osmo-nitb_10.42.42.2(pid=18678): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18678)] 09:08:19.017248 run osmo-nitb_10.42.42.2(pid=18678): stdout: | (launched: 2022-12-09_09:08:18.607704) 09:08:19.167724 run osmo-nitb_10.42.42.2(pid=18678): stderr: | (launched: 2022-12-09_09:08:18.657068) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:08:19.317449 run osmo-nitb_10.42.42.2(pid=18678): stdout: | (launched: 2022-12-09_09:08:18.607704) 09:08:19.461565 run osmo-nitb_10.42.42.2(pid=18678): stderr: | (launched: 2022-12-09_09:08:18.657068) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18678): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18678) [trial-2357↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18678)] 09:08:19.810313 tst osmo-nitb_10.42.42.2(pid=18678): stdout: | (launched: 2022-12-09_09:08:18.607704) 09:08:19.945625 tst osmo-nitb_10.42.42.2(pid=18678): stderr: | (launched: 2022-12-09_09:08:18.657068) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:08:20.106170 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18678): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18678) [trial-2357↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18678)] [trial-2357↪nitb_ussd:trx-lms↪assert_extension.py:12] 09:08:20.116245 tst assert_extension.py:12: Test FAILED (3.4 sec) 09:08:20.124324 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18677): Terminating (SIGTERM) 09:08:20.340464 --- ParallelTerminationStrategy: PID 18677 died... 09:08:20.364110 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18677): Terminated: ok {rc=0} 09:08:20.458036 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:trx-lms --------------------------------------------------------------------- 09:08:21.647704 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:21.652666 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:08:21.692744 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:08:21.723360 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:08:21.762383 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:08:21.799613 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:08:21.830055 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:08:22.356150 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:trx-lms assert_extension.py ---------------------------------------------- 09:08:22.363982 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:22.376433 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 09:08:22.432175 tst assert_extension.py: using LAC 20410 09:08:22.562340 tst assert_extension.py: using RAC 10 09:08:22.692447 tst assert_extension.py: using CellId 20410 09:08:22.823120 tst assert_extension.py: using BVCI 20411 09:08:22.945596 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:22.959703 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:22.972895 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:22.985320 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:22.998309 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:23.011334 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 09:08:23.138215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:23.654359 run create_hlr_db(pid=18682): Launched 09:08:23.820784 bus /sierra_2: Setting Powered False 09:08:24.881388 run create_hlr_db(pid=18682): Terminated: ok {rc=0} 09:08:25.299697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18685): Launched 09:08:25.601351 run osmo-hlr_10.42.42.2(pid=18686): Launched 09:08:25.716148 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:26.238709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18688): Launched 09:08:26.542193 run osmo-stp_10.42.42.5(pid=18689): Launched 09:08:26.659368 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:27.203388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18691): Launched 09:08:27.504741 run osmo-msc_10.42.42.6(pid=18692): Launched 09:08:27.674659 run osmo-stp_10.42.42.5(pid=18689): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18689)] 09:08:27.801856 run osmo-stp_10.42.42.5(pid=18689): stdout: | (launched: 2022-12-09_09:08:26.486475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:27.929571 run osmo-stp_10.42.42.5(pid=18689): stderr: | [0;m[38;5;43m20221209090826654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090826654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090826655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090826655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090826656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090826656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090826656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:28.055308 run osmo-stp_10.42.42.5(pid=18689): stdout: | (launched: 2022-12-09_09:08:26.486475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:28.175132 run osmo-stp_10.42.42.5(pid=18689): stderr: | [0;m[38;5;43m20221209090826654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090826654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090826655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090826655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090826656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090826656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090826656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:28.319854 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18689): Process ended prematurely: osmo-stp_10.42.42.5(pid=18689) [trial-2357↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18689)] [trial-2357↪ussd:trx-lms↪assert_extension.py:17] 09:08:28.328355 tst assert_extension.py:17: Test FAILED (6.0 sec) 09:08:28.354892 run osmo-hlr_10.42.42.2(pid=18686): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18686)] 09:08:28.403336 run osmo-hlr_10.42.42.2(pid=18686): stdout: | (launched: 2022-12-09_09:08:25.545205) 09:08:28.453530 run osmo-hlr_10.42.42.2(pid=18686): stderr: | [0;m[1;31m20221209090825720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090825721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090825721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090825721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090825721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090825721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090825733 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090825742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090825742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090825742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:28.523030 run osmo-msc_10.42.42.6(pid=18692): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18692)] 09:08:28.571358 run osmo-msc_10.42.42.6(pid=18692): stdout: | (launched: 2022-12-09_09:08:27.448819) 09:08:28.620618 run osmo-msc_10.42.42.6(pid=18692): stderr: | [0;m[38;5;43m20221209090827722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090827722 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d6ea3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090827722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090827722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090827722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090827722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090827724 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090827724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090827725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090827725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:28.670431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18685): Terminating (SIGTERM) 09:08:28.710394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18688): Terminating (SIGTERM) 09:08:28.750096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18691): Terminating (SIGTERM) 09:08:28.790832 --- ParallelTerminationStrategy: PID 18685 died... 09:08:28.810176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18685): Terminated: ok {rc=0} 09:08:28.854683 --- ParallelTerminationStrategy: PID 18688 died... 09:08:28.873522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18688): Terminated: ok {rc=0} 09:08:28.917674 --- ParallelTerminationStrategy: PID 18691 died... 09:08:28.936428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18691): Terminated: ok {rc=0} 09:08:29.022264 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:08:30.239309 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:30.246136 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:08:30.281145 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:08:30.308474 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:08:30.361019 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:08:30.394864 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:08:30.421938 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:08:31.005390 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:08:31.062989 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:31.075753 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:08:31.151335 tst mo_mt_call.py: using LAC 20411 09:08:31.272686 tst mo_mt_call.py: using RAC 11 09:08:31.431816 tst mo_mt_call.py: using CellId 20411 09:08:31.602694 tst mo_mt_call.py: using BVCI 20412 09:08:31.725431 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:31.738627 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:31.752300 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:31.766866 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:31.780683 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:31.794545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:08:31.938352 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:08:32.084500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:32.601980 run create_hlr_db(pid=18697): Launched 09:08:32.729389 bus /sierra_2: Setting Powered False 09:08:33.794490 run create_hlr_db(pid=18697): Terminated: ok {rc=0} 09:08:34.231338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18699): Launched 09:08:34.537343 run osmo-hlr_10.42.42.2(pid=18700): Launched 09:08:34.653529 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:35.178800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18702): Launched 09:08:35.484412 run osmo-stp_10.42.42.5(pid=18703): Launched 09:08:35.600480 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:36.155641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18705): Launched 09:08:36.462263 run osmo-msc_10.42.42.6(pid=18706): Launched 09:08:36.633563 run osmo-stp_10.42.42.5(pid=18703): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18703)] 09:08:36.762408 run osmo-stp_10.42.42.5(pid=18703): stdout: | (launched: 2022-12-09_09:08:35.427407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:36.890997 run osmo-stp_10.42.42.5(pid=18703): stderr: | [0;m[38;5;43m20221209090835599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090835599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090835600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090835600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090835601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090835601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090835601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:37.018227 run osmo-stp_10.42.42.5(pid=18703): stdout: | (launched: 2022-12-09_09:08:35.427407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:37.140287 run osmo-stp_10.42.42.5(pid=18703): stderr: | [0;m[38;5;43m20221209090835599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090835599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090835600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090835600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090835601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090835601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090835601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:37.285928 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18703): Process ended prematurely: osmo-stp_10.42.42.5(pid=18703) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18703)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:08:37.294993 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:08:37.321350 run osmo-hlr_10.42.42.2(pid=18700): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18700)] 09:08:37.369170 run osmo-hlr_10.42.42.2(pid=18700): stdout: | (launched: 2022-12-09_09:08:34.481099) 09:08:37.418425 run osmo-hlr_10.42.42.2(pid=18700): stderr: | [0;m[1;31m20221209090834658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090834659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090834659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090834659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090834659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090834659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090834671 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090834680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090834680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090834680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:37.487403 run osmo-msc_10.42.42.6(pid=18706): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18706)] 09:08:37.534900 run osmo-msc_10.42.42.6(pid=18706): stdout: | (launched: 2022-12-09_09:08:36.405926) 09:08:37.583980 run osmo-msc_10.42.42.6(pid=18706): stderr: | [0;m[38;5;43m20221209090836678 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090836679 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa643a4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090836679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090836679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090836679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090836679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090836681 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090836681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090836681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090836681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:37.633459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18699): Terminating (SIGTERM) 09:08:37.673178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18702): Terminating (SIGTERM) 09:08:37.713642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18705): Terminating (SIGTERM) 09:08:37.754252 --- ParallelTerminationStrategy: PID 18699 died... 09:08:37.773360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18699): Terminated: ok {rc=0} 09:08:37.817471 --- ParallelTerminationStrategy: PID 18702 died... 09:08:37.836048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18702): Terminated: ok {rc=0} 09:08:37.880089 --- ParallelTerminationStrategy: PID 18705 died... 09:08:37.898990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18705): Terminated: ok {rc=0} 09:08:37.986238 bus /sierra_3: Setting Powered False 09:08:39.087669 bus /sierra_3: Setting Powered False 09:08:40.200659 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:08:41.350317 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:41.363201 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:08:41.435880 tst mo_mt_call_osmux.py: using LAC 20412 09:08:41.562892 tst mo_mt_call_osmux.py: using RAC 12 09:08:41.690208 tst mo_mt_call_osmux.py: using CellId 20412 09:08:41.818293 tst mo_mt_call_osmux.py: using BVCI 20413 09:08:41.937407 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:41.949192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:41.960746 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:41.972605 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:41.984443 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:08:41.996263 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:08:42.116429 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:08:42.240055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:42.718051 run create_hlr_db(pid=18708): Launched 09:08:42.845210 bus /sierra_2: Setting Powered False 09:08:43.906805 run create_hlr_db(pid=18708): Terminated: ok {rc=0} 09:08:44.334207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18710): Launched 09:08:44.641741 run osmo-hlr_10.42.42.2(pid=18711): Launched 09:08:44.758850 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:45.302089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18713): Launched 09:08:45.611272 run osmo-stp_10.42.42.5(pid=18714): Launched 09:08:45.728461 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:46.347557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18716): Launched 09:08:46.696559 run osmo-msc_10.42.42.6(pid=18717): Launched 09:08:46.958400 run osmo-stp_10.42.42.5(pid=18714): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18714)] 09:08:47.168183 run osmo-stp_10.42.42.5(pid=18714): stdout: | (launched: 2022-12-09_09:08:45.554536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:47.384375 run osmo-stp_10.42.42.5(pid=18714): stderr: | [0;m[38;5;43m20221209090845724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090845725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090845725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090845725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090845726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090845726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090845726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:47.525698 run osmo-stp_10.42.42.5(pid=18714): stdout: | (launched: 2022-12-09_09:08:45.554536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:47.658430 run osmo-stp_10.42.42.5(pid=18714): stderr: | [0;m[38;5;43m20221209090845724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090845725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090845725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090845725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090845726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090845726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090845726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:47.815467 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18714): Process ended prematurely: osmo-stp_10.42.42.5(pid=18714) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18714)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:08:47.825173 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:08:47.854574 run osmo-hlr_10.42.42.2(pid=18711): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18711)] 09:08:47.906006 run osmo-hlr_10.42.42.2(pid=18711): stdout: | (launched: 2022-12-09_09:08:44.585691) 09:08:47.959333 run osmo-hlr_10.42.42.2(pid=18711): stderr: | [0;m[1;31m20221209090844761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090844761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090844761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090844761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090844761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090844761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090844773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090844781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090844782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090844782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:48.033122 run osmo-msc_10.42.42.6(pid=18717): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18717)] 09:08:48.084505 run osmo-msc_10.42.42.6(pid=18717): stdout: | (launched: 2022-12-09_09:08:46.635372) 09:08:48.137439 run osmo-msc_10.42.42.6(pid=18717): stderr: | [0;m[38;5;43m20221209090847303 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090847303 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe045cd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090847303 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090847303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090847303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090847303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090847305 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090847305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090847306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090847306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:48.191017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18710): Terminating (SIGTERM) 09:08:48.233743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18713): Terminating (SIGTERM) 09:08:48.276792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18716): Terminating (SIGTERM) 09:08:48.319821 --- ParallelTerminationStrategy: PID 18710 died... 09:08:48.340126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18710): Terminated: ok {rc=0} 09:08:48.388057 --- ParallelTerminationStrategy: PID 18713 died... 09:08:48.407765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18713): Terminated: ok {rc=0} 09:08:48.455772 --- ParallelTerminationStrategy: PID 18716 died... 09:08:48.475396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18716): Terminated: ok {rc=0} 09:08:48.565062 bus /sierra_3: Setting Powered False 09:08:49.664171 bus /sierra_3: Setting Powered False 09:08:50.779695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:08:52.035886 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:52.042974 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:08:52.078288 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:08:52.106425 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:08:52.161156 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:08:52.195832 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:08:52.223954 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:08:52.777828 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:08:52.830687 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:08:52.842395 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:08:52.916213 tst mo_mt_call.py: using LAC 20413 09:08:53.045599 tst mo_mt_call.py: using RAC 13 09:08:53.166944 tst mo_mt_call.py: using CellId 20413 09:08:53.289379 tst mo_mt_call.py: using BVCI 20414 09:08:53.400386 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:08:53.411824 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:08:53.423165 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:08:53.434588 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:08:53.446084 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:08:53.457460 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:08:53.579489 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:08:53.699881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:54.176514 run create_hlr_db(pid=18722): Launched 09:08:54.302054 bus /sierra_2: Setting Powered False 09:08:55.363191 run create_hlr_db(pid=18722): Terminated: ok {rc=0} 09:08:55.811381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18724): Launched 09:08:56.141639 run osmo-hlr_10.42.42.2(pid=18725): Launched 09:08:56.269566 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:56.834922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18727): Launched 09:08:57.162429 run osmo-stp_10.42.42.5(pid=18728): Launched 09:08:57.281031 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:57.839087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18730): Launched 09:08:58.146054 run osmo-msc_10.42.42.6(pid=18731): Launched 09:08:58.318064 run osmo-stp_10.42.42.5(pid=18728): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18728)] 09:08:58.447269 run osmo-stp_10.42.42.5(pid=18728): stdout: | (launched: 2022-12-09_09:08:57.102343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:58.577999 run osmo-stp_10.42.42.5(pid=18728): stderr: | [0;m[38;5;43m20221209090857274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090857274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090857275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090857275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090857275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090857276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090857276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:58.705896 run osmo-stp_10.42.42.5(pid=18728): stdout: | (launched: 2022-12-09_09:08:57.102343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:58.837584 run osmo-stp_10.42.42.5(pid=18728): stderr: | [0;m[38;5;43m20221209090857274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090857274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090857275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090857275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090857275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090857276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090857276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:58.980327 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18728): Process ended prematurely: osmo-stp_10.42.42.5(pid=18728) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18728)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:08:58.989347 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:08:59.016068 run osmo-hlr_10.42.42.2(pid=18725): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18725)] 09:08:59.063062 run osmo-hlr_10.42.42.2(pid=18725): stdout: | (launched: 2022-12-09_09:08:56.081763) 09:08:59.112045 run osmo-hlr_10.42.42.2(pid=18725): stderr: | [0;m[1;31m20221209090856278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090856278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090856278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090856278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090856278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090856279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090856291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090856300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090856300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090856300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:59.179857 run osmo-msc_10.42.42.6(pid=18731): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18731)] 09:08:59.226851 run osmo-msc_10.42.42.6(pid=18731): stdout: | (launched: 2022-12-09_09:08:58.089711) 09:08:59.275494 run osmo-msc_10.42.42.6(pid=18731): stderr: | [0;m[38;5;43m20221209090858363 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090858363 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc7fc42fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090858363 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090858363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090858364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090858364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090858365 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090858366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090858366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090858366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:59.324891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18724): Terminating (SIGTERM) 09:08:59.364691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18727): Terminating (SIGTERM) 09:08:59.404191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18730): Terminating (SIGTERM) 09:08:59.443953 --- ParallelTerminationStrategy: PID 18724 died... 09:08:59.462987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18724): Terminated: ok {rc=0} 09:08:59.506664 --- ParallelTerminationStrategy: PID 18727 died... 09:08:59.525254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18727): Terminated: ok {rc=0} 09:08:59.569196 --- ParallelTerminationStrategy: PID 18730 died... 09:08:59.587920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18730): Terminated: ok {rc=0} 09:08:59.673394 bus /sierra_3: Setting Powered False 09:09:00.775528 bus /sierra_3: Setting Powered False 09:09:01.899836 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:09:03.045138 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:03.056741 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:09:03.126164 tst mo_mt_call_osmux.py: using LAC 20414 09:09:03.244528 tst mo_mt_call_osmux.py: using RAC 14 09:09:03.360705 tst mo_mt_call_osmux.py: using CellId 20414 09:09:03.477781 tst mo_mt_call_osmux.py: using BVCI 20415 09:09:03.585516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:03.596586 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:03.607516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:03.618486 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:03.629536 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:09:03.640446 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:09:03.760552 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:09:03.881022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:04.379167 run create_hlr_db(pid=18733): Launched 09:09:04.501360 bus /sierra_2: Setting Powered False 09:09:05.564934 run create_hlr_db(pid=18733): Terminated: ok {rc=0} 09:09:05.991955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18735): Launched 09:09:06.290915 run osmo-hlr_10.42.42.2(pid=18736): Launched 09:09:06.404896 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:06.920902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18738): Launched 09:09:07.219992 run osmo-stp_10.42.42.5(pid=18739): Launched 09:09:07.334226 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:07.877127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18741): Launched 09:09:08.176688 run osmo-msc_10.42.42.6(pid=18742): Launched 09:09:08.344818 run osmo-stp_10.42.42.5(pid=18739): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18739)] 09:09:08.471580 run osmo-stp_10.42.42.5(pid=18739): stdout: | (launched: 2022-12-09_09:09:07.164734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:08.599202 run osmo-stp_10.42.42.5(pid=18739): stderr: | [0;m[38;5;43m20221209090907331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090907331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090907332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090907332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090907332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090907333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090907333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:08.723888 run osmo-stp_10.42.42.5(pid=18739): stdout: | (launched: 2022-12-09_09:09:07.164734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:08.843130 run osmo-stp_10.42.42.5(pid=18739): stderr: | [0;m[38;5;43m20221209090907331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090907331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090907332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090907332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090907332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090907333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090907333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:08.986175 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18739): Process ended prematurely: osmo-stp_10.42.42.5(pid=18739) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18739)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:09:08.995082 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:09:09.021986 run osmo-hlr_10.42.42.2(pid=18736): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18736)] 09:09:09.079191 run osmo-hlr_10.42.42.2(pid=18736): stdout: | (launched: 2022-12-09_09:09:06.235857) 09:09:09.128694 run osmo-hlr_10.42.42.2(pid=18736): stderr: | [0;m[1;31m20221209090906408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090906408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090906408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090906408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090906408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090906408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090906420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090906429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090906429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090906429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:09.197682 run osmo-msc_10.42.42.6(pid=18742): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18742)] 09:09:09.245391 run osmo-msc_10.42.42.6(pid=18742): stdout: | (launched: 2022-12-09_09:09:08.121257) 09:09:09.294664 run osmo-msc_10.42.42.6(pid=18742): stderr: | [0;m[38;5;43m20221209090908390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090908390 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c56ae6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090908390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090908390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090908390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090908390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090908392 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090908392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090908393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090908393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:09.344033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18735): Terminating (SIGTERM) 09:09:09.383862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18738): Terminating (SIGTERM) 09:09:09.423612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18741): Terminating (SIGTERM) 09:09:09.463650 --- ParallelTerminationStrategy: PID 18735 died... 09:09:09.482707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18735): Terminated: ok {rc=0} 09:09:09.526718 --- ParallelTerminationStrategy: PID 18738 died... 09:09:09.544999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18738): Terminated: ok {rc=0} 09:09:09.588873 --- ParallelTerminationStrategy: PID 18741 died... 09:09:09.607604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18741): Terminated: ok {rc=0} 09:09:09.692021 bus /sierra_3: Setting Powered False 09:09:10.791075 bus /sierra_3: Setting Powered False 09:09:11.905074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:09:13.154184 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:13.160412 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:09:13.193362 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:09:13.220096 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:09:13.271958 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:09:13.304708 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:09:13.331136 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:09:13.887380 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:09:13.938691 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:13.950479 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:09:14.024469 tst mo_mt_call.py: using LAC 20415 09:09:14.147611 tst mo_mt_call.py: using RAC 15 09:09:14.269098 tst mo_mt_call.py: using CellId 20415 09:09:14.391152 tst mo_mt_call.py: using BVCI 20416 09:09:14.507100 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:14.518744 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:14.530155 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:14.541809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:14.553377 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:14.565341 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:14.679958 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:14.796639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:15.287074 run create_hlr_db(pid=18747): Launched 09:09:15.409160 bus /sierra_2: Setting Powered False 09:09:16.470966 run create_hlr_db(pid=18747): Terminated: ok {rc=0} 09:09:16.935050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18749): Launched 09:09:17.271946 run osmo-hlr_10.42.42.2(pid=18750): Launched 09:09:17.397260 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:17.951270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18752): Launched 09:09:18.272019 run osmo-stp_10.42.42.5(pid=18753): Launched 09:09:18.394751 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:18.974517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18755): Launched 09:09:19.294654 run osmo-msc_10.42.42.6(pid=18756): Launched 09:09:19.473414 run osmo-stp_10.42.42.5(pid=18753): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18753)] 09:09:19.608926 run osmo-stp_10.42.42.5(pid=18753): stdout: | (launched: 2022-12-09_09:09:18.213661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:19.744540 run osmo-stp_10.42.42.5(pid=18753): stderr: | [0;m[38;5;43m20221209090918400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090918400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090918401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090918401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090918401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090918401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090918402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:19.878175 run osmo-stp_10.42.42.5(pid=18753): stdout: | (launched: 2022-12-09_09:09:18.213661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:20.006135 run osmo-stp_10.42.42.5(pid=18753): stderr: | [0;m[38;5;43m20221209090918400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090918400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090918401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090918401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090918401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090918401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090918402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:20.159018 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18753): Process ended prematurely: osmo-stp_10.42.42.5(pid=18753) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18753)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:09:20.168427 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:09:20.196574 run osmo-hlr_10.42.42.2(pid=18750): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18750)] 09:09:20.246673 run osmo-hlr_10.42.42.2(pid=18750): stdout: | (launched: 2022-12-09_09:09:17.213464) 09:09:20.298269 run osmo-hlr_10.42.42.2(pid=18750): stderr: | [0;m[1;31m20221209090917406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090917406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090917406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090917406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090917406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090917406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090917418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090917427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090917427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090917427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:20.369765 run osmo-msc_10.42.42.6(pid=18756): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18756)] 09:09:20.419510 run osmo-msc_10.42.42.6(pid=18756): stdout: | (launched: 2022-12-09_09:09:19.236135) 09:09:20.470814 run osmo-msc_10.42.42.6(pid=18756): stderr: | [0;m[38;5;43m20221209090919553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090919553 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f60c1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090919553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090919553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090919554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090919554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090919555 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090919556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090919556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090919556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:20.522814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18749): Terminating (SIGTERM) 09:09:20.564800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18752): Terminating (SIGTERM) 09:09:20.607048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18755): Terminating (SIGTERM) 09:09:20.648998 --- ParallelTerminationStrategy: PID 18749 died... 09:09:20.668817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18749): Terminated: ok {rc=0} 09:09:20.715212 --- ParallelTerminationStrategy: PID 18752 died... 09:09:20.734622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18752): Terminated: ok {rc=0} 09:09:20.780835 --- ParallelTerminationStrategy: PID 18755 died... 09:09:20.800517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18755): Terminated: ok {rc=0} 09:09:20.888489 bus /sierra_3: Setting Powered False 09:09:21.986909 bus /sierra_3: Setting Powered False 09:09:23.106651 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:09:24.249377 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:24.261218 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:09:24.331419 tst mo_mt_call_osmux.py: using LAC 20416 09:09:24.455464 tst mo_mt_call_osmux.py: using RAC 16 09:09:24.572746 tst mo_mt_call_osmux.py: using CellId 20416 09:09:24.687398 tst mo_mt_call_osmux.py: using BVCI 20417 09:09:24.804778 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:24.816626 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:24.828358 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:24.840285 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:24.852058 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:09:24.863987 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:24.984069 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:09:25.106045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:25.604924 run create_hlr_db(pid=18758): Launched 09:09:25.727665 bus /sierra_2: Setting Powered False 09:09:26.790299 run create_hlr_db(pid=18758): Terminated: ok {rc=0} 09:09:27.218781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Launched 09:09:27.518745 run osmo-hlr_10.42.42.2(pid=18761): Launched 09:09:27.634744 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:28.150354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Launched 09:09:28.449908 run osmo-stp_10.42.42.5(pid=18764): Launched 09:09:28.564823 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:29.109362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18766): Launched 09:09:29.408730 run osmo-msc_10.42.42.6(pid=18767): Launched 09:09:29.581831 run osmo-stp_10.42.42.5(pid=18764): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] 09:09:29.714969 run osmo-stp_10.42.42.5(pid=18764): stdout: | (launched: 2022-12-09_09:09:28.394546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:29.841315 run osmo-stp_10.42.42.5(pid=18764): stderr: | [0;m[38;5;43m20221209090928561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090928561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090928561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090928562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090928562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090928562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090928562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:29.966289 run osmo-stp_10.42.42.5(pid=18764): stdout: | (launched: 2022-12-09_09:09:28.394546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:30.086006 run osmo-stp_10.42.42.5(pid=18764): stderr: | [0;m[38;5;43m20221209090928561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090928561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090928561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090928562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090928562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090928562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090928562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:30.229095 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18764): Process ended prematurely: osmo-stp_10.42.42.5(pid=18764) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:09:30.237781 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:09:30.264196 run osmo-hlr_10.42.42.2(pid=18761): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18761)] 09:09:30.312298 run osmo-hlr_10.42.42.2(pid=18761): stdout: | (launched: 2022-12-09_09:09:27.463567) 09:09:30.362024 run osmo-hlr_10.42.42.2(pid=18761): stderr: | [0;m[1;31m20221209090927634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090927635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090927635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090927635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090927635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090927635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090927646 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090927655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090927655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090927655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:30.431364 run osmo-msc_10.42.42.6(pid=18767): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18767)] 09:09:30.479245 run osmo-msc_10.42.42.6(pid=18767): stdout: | (launched: 2022-12-09_09:09:29.353636) 09:09:30.528811 run osmo-msc_10.42.42.6(pid=18767): stderr: | [0;m[38;5;43m20221209090929621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090929621 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f918d512c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090929621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090929621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090929622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090929622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090929623 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090929624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090929624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090929624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:30.578756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Terminating (SIGTERM) 09:09:30.618372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Terminating (SIGTERM) 09:09:30.658056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18766): Terminating (SIGTERM) 09:09:30.698046 --- ParallelTerminationStrategy: PID 18760 died... 09:09:30.717086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18760): Terminated: ok {rc=0} 09:09:30.761701 --- ParallelTerminationStrategy: PID 18763 died... 09:09:30.780334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18763): Terminated: ok {rc=0} 09:09:30.824254 --- ParallelTerminationStrategy: PID 18766 died... 09:09:30.854658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18766): Terminated: ok {rc=0} 09:09:30.952255 bus /sierra_3: Setting Powered False 09:09:32.058828 bus /sierra_3: Setting Powered False 09:09:33.177447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:09:34.430980 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:34.437225 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:09:34.470375 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:09:34.497308 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:09:34.550869 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:09:34.585361 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:09:34.612109 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:09:35.161877 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:09:35.209695 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:35.220845 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:09:35.290242 tst mo_mt_call.py: using LAC 20417 09:09:35.409188 tst mo_mt_call.py: using RAC 17 09:09:35.526280 tst mo_mt_call.py: using CellId 20417 09:09:35.654098 tst mo_mt_call.py: using BVCI 20418 09:09:35.770657 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:35.782706 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:35.794335 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:35.806353 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:35.818499 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:35.830533 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:09:35.947432 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:09:36.065264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:36.530345 run create_hlr_db(pid=18772): Launched 09:09:36.653654 bus /sierra_2: Setting Powered False 09:09:37.713964 run create_hlr_db(pid=18772): Terminated: ok {rc=0} 09:09:38.130977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18774): Launched 09:09:38.430278 run osmo-hlr_10.42.42.2(pid=18775): Launched 09:09:38.543201 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:39.058187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18777): Launched 09:09:39.356362 run osmo-stp_10.42.42.5(pid=18778): Launched 09:09:39.470696 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:40.012082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18780): Launched 09:09:40.311710 run osmo-msc_10.42.42.6(pid=18781): Launched 09:09:40.479284 run osmo-stp_10.42.42.5(pid=18778): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18778)] 09:09:40.605306 run osmo-stp_10.42.42.5(pid=18778): stdout: | (launched: 2022-12-09_09:09:39.301181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:40.731206 run osmo-stp_10.42.42.5(pid=18778): stderr: | [0;m[38;5;43m20221209090939468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090939468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090939469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090939469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090939469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090939470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090939470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:40.855744 run osmo-stp_10.42.42.5(pid=18778): stdout: | (launched: 2022-12-09_09:09:39.301181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:40.974731 run osmo-stp_10.42.42.5(pid=18778): stderr: | [0;m[38;5;43m20221209090939468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090939468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090939469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090939469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090939469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090939470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090939470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:41.116821 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18778): Process ended prematurely: osmo-stp_10.42.42.5(pid=18778) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18778)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:09:41.125634 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:09:41.151655 run osmo-hlr_10.42.42.2(pid=18775): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18775)] 09:09:41.198932 run osmo-hlr_10.42.42.2(pid=18775): stdout: | (launched: 2022-12-09_09:09:38.374923) 09:09:41.247995 run osmo-hlr_10.42.42.2(pid=18775): stderr: | [0;m[1;31m20221209090938545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090938545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090938545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090938545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090938545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090938545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090938557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090938568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090938568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090938568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:41.316276 run osmo-msc_10.42.42.6(pid=18781): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18781)] 09:09:41.363649 run osmo-msc_10.42.42.6(pid=18781): stdout: | (launched: 2022-12-09_09:09:40.256354) 09:09:41.412523 run osmo-msc_10.42.42.6(pid=18781): stderr: | [0;m[38;5;43m20221209090940528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090940528 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f16ae800c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090940528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090940529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090940529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090940529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090940531 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090940531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090940531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090940531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:41.461878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18774): Terminating (SIGTERM) 09:09:41.501128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18777): Terminating (SIGTERM) 09:09:41.540321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18780): Terminating (SIGTERM) 09:09:41.579747 --- ParallelTerminationStrategy: PID 18774 died... 09:09:41.598645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18774): Terminated: ok {rc=0} 09:09:41.642015 --- ParallelTerminationStrategy: PID 18777 died... 09:09:41.660427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18777): Terminated: ok {rc=0} 09:09:41.704169 --- ParallelTerminationStrategy: PID 18780 died... 09:09:41.722669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18780): Terminated: ok {rc=0} 09:09:41.808181 bus /sierra_3: Setting Powered False 09:09:42.908465 bus /sierra_3: Setting Powered False 09:09:44.023674 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:09:45.169300 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:45.181189 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:09:45.256168 tst mo_mt_call_osmux.py: using LAC 20418 09:09:45.373372 tst mo_mt_call_osmux.py: using RAC 18 09:09:45.489815 tst mo_mt_call_osmux.py: using CellId 20418 09:09:45.608124 tst mo_mt_call_osmux.py: using BVCI 20419 09:09:45.716696 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:45.728010 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:45.738992 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:45.750076 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:45.761119 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:09:45.772094 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:09:45.910659 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:09:46.038639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:46.523166 run create_hlr_db(pid=18784): Launched 09:09:46.682602 bus /sierra_2: Setting Powered False 09:09:47.742959 run create_hlr_db(pid=18784): Terminated: ok {rc=0} 09:09:48.180711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18786): Launched 09:09:48.502376 run osmo-hlr_10.42.42.2(pid=18787): Launched 09:09:48.625863 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:49.177730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18789): Launched 09:09:49.499355 run osmo-stp_10.42.42.5(pid=18790): Launched 09:09:49.622982 run osmo-msc_10.42.42.6: Starting osmo-msc 09:09:50.205660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18792): Launched 09:09:50.529077 run osmo-msc_10.42.42.6(pid=18793): Launched 09:09:50.709974 run osmo-stp_10.42.42.5(pid=18790): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18790)] 09:09:50.847779 run osmo-stp_10.42.42.5(pid=18790): stdout: | (launched: 2022-12-09_09:09:49.440365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:50.984622 run osmo-stp_10.42.42.5(pid=18790): stderr: | [0;m[38;5;43m20221209090949628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090949628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090949628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090949629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090949629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090949629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090949629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:51.120518 run osmo-stp_10.42.42.5(pid=18790): stdout: | (launched: 2022-12-09_09:09:49.440365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:51.250679 run osmo-stp_10.42.42.5(pid=18790): stderr: | [0;m[38;5;43m20221209090949628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209090949628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209090949628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209090949629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209090949629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209090949629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209090949629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:51.405899 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18790): Process ended prematurely: osmo-stp_10.42.42.5(pid=18790) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18790)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:09:51.415667 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:09:51.444340 run osmo-hlr_10.42.42.2(pid=18787): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18787)] 09:09:51.495251 run osmo-hlr_10.42.42.2(pid=18787): stdout: | (launched: 2022-12-09_09:09:48.443744) 09:09:51.547992 run osmo-hlr_10.42.42.2(pid=18787): stderr: | [0;m[1;31m20221209090948636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090948636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090948636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090948636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090948637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090948637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090948650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090948658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090948658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090948658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:51.622098 run osmo-msc_10.42.42.6(pid=18793): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18793)] 09:09:51.672917 run osmo-msc_10.42.42.6(pid=18793): stdout: | (launched: 2022-12-09_09:09:50.469970) 09:09:51.725424 run osmo-msc_10.42.42.6(pid=18793): stderr: | [0;m[38;5;43m20221209090950793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209090950793 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f499d2dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209090950793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209090950793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209090950793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209090950793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209090950795 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209090950795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209090950796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209090950796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:09:51.778245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18786): Terminating (SIGTERM) 09:09:51.820816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18789): Terminating (SIGTERM) 09:09:51.863649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18792): Terminating (SIGTERM) 09:09:51.906658 --- ParallelTerminationStrategy: PID 18786 died... 09:09:51.926788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18786): Terminated: ok {rc=0} 09:09:51.973384 --- ParallelTerminationStrategy: PID 18789 died... 09:09:51.993012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18789): Terminated: ok {rc=0} 09:09:52.039770 --- ParallelTerminationStrategy: PID 18792 died... 09:09:52.059401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18792): Terminated: ok {rc=0} 09:09:52.147173 bus /sierra_3: Setting Powered False 09:09:53.246343 bus /sierra_3: Setting Powered False 09:09:54.362103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:09:55.627408 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:55.634866 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:09:55.669645 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:09:55.697367 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:09:55.756128 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:09:55.790702 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:09:55.818407 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:09:56.366901 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:09:56.418562 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:09:56.430149 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:09:56.499921 tst mo_mt_call.py: using LAC 20419 09:09:56.625385 tst mo_mt_call.py: using RAC 19 09:09:56.749638 tst mo_mt_call.py: using CellId 20419 09:09:56.868575 tst mo_mt_call.py: using BVCI 20420 09:09:56.977644 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:09:56.988674 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:09:56.999592 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:09:57.010607 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:09:57.022218 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:09:57.033126 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:09:57.146961 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:09:57.265681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:57.765289 run create_hlr_db(pid=18798): Launched 09:09:57.887300 bus /sierra_2: Setting Powered False 09:09:58.950475 run create_hlr_db(pid=18798): Terminated: ok {rc=0} 09:09:59.379740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18800): Launched 09:09:59.680744 run osmo-hlr_10.42.42.2(pid=18801): Launched 09:09:59.795223 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:00.328630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18803): Launched 09:10:00.628313 run osmo-stp_10.42.42.5(pid=18804): Launched 09:10:00.742708 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:01.456889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18809): Launched 09:10:01.822642 run osmo-msc_10.42.42.6(pid=18810): Launched 09:10:02.166099 run osmo-stp_10.42.42.5(pid=18804): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18804)] 09:10:02.306249 run osmo-stp_10.42.42.5(pid=18804): stdout: | (launched: 2022-12-09_09:10:00.572936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:02.494587 run osmo-stp_10.42.42.5(pid=18804): stderr: | [0;m[38;5;43m20221209091000739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091000739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091000739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091000740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091000740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091000740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091000740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:02.633984 run osmo-stp_10.42.42.5(pid=18804): stdout: | (launched: 2022-12-09_09:10:00.572936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:02.763103 run osmo-stp_10.42.42.5(pid=18804): stderr: | [0;m[38;5;43m20221209091000739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091000739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091000739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091000740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091000740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091000740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091000740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:02.916633 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18804): Process ended prematurely: osmo-stp_10.42.42.5(pid=18804) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18804)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:10:02.926184 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:10:02.954030 run osmo-hlr_10.42.42.2(pid=18801): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18801)] 09:10:03.004578 run osmo-hlr_10.42.42.2(pid=18801): stdout: | (launched: 2022-12-09_09:09:59.625750) 09:10:03.056810 run osmo-hlr_10.42.42.2(pid=18801): stderr: | [0;m[1;31m20221209090959797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209090959797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209090959797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209090959797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209090959797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209090959797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209090959809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209090959817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209090959817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209090959818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:03.129396 run osmo-msc_10.42.42.6(pid=18810): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18810)] 09:10:03.179914 run osmo-msc_10.42.42.6(pid=18810): stdout: | (launched: 2022-12-09_09:10:01.763526) 09:10:03.232007 run osmo-msc_10.42.42.6(pid=18810): stderr: | [0;m[38;5;43m20221209091002382 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091002383 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa17c94ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091002383 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091002383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091002383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091002383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091002385 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091002386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091002386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091002386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:03.284488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18800): Terminating (SIGTERM) 09:10:03.326579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18803): Terminating (SIGTERM) 09:10:03.368448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18809): Terminating (SIGTERM) 09:10:03.410753 --- ParallelTerminationStrategy: PID 18800 died... 09:10:03.430729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18800): Terminated: ok {rc=0} 09:10:03.477052 --- ParallelTerminationStrategy: PID 18803 died... 09:10:03.496555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18803): Terminated: ok {rc=0} 09:10:03.542756 --- ParallelTerminationStrategy: PID 18809 died... 09:10:03.562212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18809): Terminated: ok {rc=0} 09:10:03.650284 bus /sierra_3: Setting Powered False 09:10:04.747986 bus /sierra_3: Setting Powered False 09:10:05.866256 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:10:07.011402 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:07.023378 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:10:07.094425 tst mo_mt_call_osmux.py: using LAC 20420 09:10:07.212907 tst mo_mt_call_osmux.py: using RAC 20 09:10:07.329590 tst mo_mt_call_osmux.py: using CellId 20420 09:10:07.446697 tst mo_mt_call_osmux.py: using BVCI 20421 09:10:07.555124 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:07.566357 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:07.577455 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:07.588357 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:07.599378 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:10:07.610405 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:10:07.728903 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:10:07.846674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:08.314415 run create_hlr_db(pid=18812): Launched 09:10:08.435973 bus /sierra_2: Setting Powered False 09:10:09.496166 run create_hlr_db(pid=18812): Terminated: ok {rc=0} 09:10:09.912703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Launched 09:10:10.211980 run osmo-hlr_10.42.42.2(pid=18815): Launched 09:10:10.326088 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:10.850370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Launched 09:10:11.149591 run osmo-stp_10.42.42.5(pid=18818): Launched 09:10:11.262642 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:11.802933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18820): Launched 09:10:12.102042 run osmo-msc_10.42.42.6(pid=18821): Launched 09:10:12.268432 run osmo-stp_10.42.42.5(pid=18818): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] 09:10:12.394808 run osmo-stp_10.42.42.5(pid=18818): stdout: | (launched: 2022-12-09_09:10:11.094610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:12.520721 run osmo-stp_10.42.42.5(pid=18818): stderr: | [0;m[38;5;43m20221209091011262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091011262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091011262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091011263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091011263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091011263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091011263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:12.645280 run osmo-stp_10.42.42.5(pid=18818): stdout: | (launched: 2022-12-09_09:10:11.094610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:12.764408 run osmo-stp_10.42.42.5(pid=18818): stderr: | [0;m[38;5;43m20221209091011262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091011262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091011262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091011263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091011263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091011263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091011263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:12.906783 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18818): Process ended prematurely: osmo-stp_10.42.42.5(pid=18818) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:10:12.915571 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 09:10:12.941955 run osmo-hlr_10.42.42.2(pid=18815): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18815)] 09:10:12.989531 run osmo-hlr_10.42.42.2(pid=18815): stdout: | (launched: 2022-12-09_09:10:10.156444) 09:10:13.038760 run osmo-hlr_10.42.42.2(pid=18815): stderr: | [0;m[1;31m20221209091010327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091010327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091010327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091010327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091010327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091010328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091010340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091010349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091010349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091010349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:13.108132 run osmo-msc_10.42.42.6(pid=18821): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18821)] 09:10:13.155894 run osmo-msc_10.42.42.6(pid=18821): stdout: | (launched: 2022-12-09_09:10:12.046770) 09:10:13.205158 run osmo-msc_10.42.42.6(pid=18821): stderr: | [0;m[38;5;43m20221209091012313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091012313 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f088af16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091012313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091012313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091012313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091012314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091012315 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091012316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091012316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091012316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:13.254380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Terminating (SIGTERM) 09:10:13.294160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Terminating (SIGTERM) 09:10:13.333402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18820): Terminating (SIGTERM) 09:10:13.373351 --- ParallelTerminationStrategy: PID 18814 died... 09:10:13.392086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18814): Terminated: ok {rc=0} 09:10:13.435595 --- ParallelTerminationStrategy: PID 18817 died... 09:10:13.454115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18817): Terminated: ok {rc=0} 09:10:13.497273 --- ParallelTerminationStrategy: PID 18820 died... 09:10:13.515694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18820): Terminated: ok {rc=0} 09:10:13.601095 bus /sierra_3: Setting Powered False 09:10:14.699193 bus /sierra_3: Setting Powered False 09:10:15.813980 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:10:17.117910 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:17.125949 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:10:17.160381 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:10:17.188140 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:10:17.240815 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:10:17.283249 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:10:17.311417 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:10:17.852879 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:10:17.906241 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:17.918110 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:10:17.990607 tst mo_mt_call.py: using LAC 20421 09:10:18.115472 tst mo_mt_call.py: using RAC 21 09:10:18.240151 tst mo_mt_call.py: using CellId 20421 09:10:18.365179 tst mo_mt_call.py: using BVCI 20422 09:10:18.481581 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:18.493338 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:18.504843 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:18.516675 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:18.528514 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:18.540676 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:18.659186 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:18.774021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:19.238664 run create_hlr_db(pid=18826): Launched 09:10:19.361236 bus /sierra_2: Setting Powered False 09:10:20.421037 run create_hlr_db(pid=18826): Terminated: ok {rc=0} 09:10:20.859245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18828): Launched 09:10:21.180181 run osmo-hlr_10.42.42.2(pid=18829): Launched 09:10:21.302788 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:21.854231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18831): Launched 09:10:22.174186 run osmo-stp_10.42.42.5(pid=18832): Launched 09:10:22.295883 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:22.875709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18834): Launched 09:10:23.196738 run osmo-msc_10.42.42.6(pid=18835): Launched 09:10:23.377066 run osmo-stp_10.42.42.5(pid=18832): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18832)] 09:10:23.517238 run osmo-stp_10.42.42.5(pid=18832): stdout: | (launched: 2022-12-09_09:10:22.115805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:23.654714 run osmo-stp_10.42.42.5(pid=18832): stderr: | [0;m[38;5;43m20221209091022303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091022303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091022303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091022304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091022304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091022304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091022304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:23.789819 run osmo-stp_10.42.42.5(pid=18832): stdout: | (launched: 2022-12-09_09:10:22.115805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:23.918672 run osmo-stp_10.42.42.5(pid=18832): stderr: | [0;m[38;5;43m20221209091022303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091022303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091022303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091022304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091022304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091022304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091022304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:24.072625 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18832): Process ended prematurely: osmo-stp_10.42.42.5(pid=18832) [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18832)] [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:10:24.082431 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:10:24.110753 run osmo-hlr_10.42.42.2(pid=18829): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18829)] 09:10:24.161057 run osmo-hlr_10.42.42.2(pid=18829): stdout: | (launched: 2022-12-09_09:10:21.121515) 09:10:24.212924 run osmo-hlr_10.42.42.2(pid=18829): stderr: | [0;m[1;31m20221209091021315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091021315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091021315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091021315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091021315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091021315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091021327 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091021336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091021336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091021336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:24.285596 run osmo-msc_10.42.42.6(pid=18835): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18835)] 09:10:24.335758 run osmo-msc_10.42.42.6(pid=18835): stdout: | (launched: 2022-12-09_09:10:23.137857) 09:10:24.387664 run osmo-msc_10.42.42.6(pid=18835): stderr: | [0;m[38;5;43m20221209091023454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091023454 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff75d973c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091023454 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091023454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091023454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091023454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091023457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091023457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091023457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091023457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:24.439967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18828): Terminating (SIGTERM) 09:10:24.482118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18831): Terminating (SIGTERM) 09:10:24.523996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18834): Terminating (SIGTERM) 09:10:24.566059 --- ParallelTerminationStrategy: PID 18828 died... 09:10:24.585988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18828): Terminated: ok {rc=0} 09:10:24.632873 --- ParallelTerminationStrategy: PID 18831 died... 09:10:24.652411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18831): Terminated: ok {rc=0} 09:10:24.698241 --- ParallelTerminationStrategy: PID 18834 died... 09:10:24.717809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18834): Terminated: ok {rc=0} 09:10:24.804488 bus /sierra_3: Setting Powered False 09:10:25.902890 bus /sierra_3: Setting Powered False 09:10:27.018320 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:10:28.163084 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:28.174914 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:10:28.246563 tst mo_mt_call_osmux.py: using LAC 20422 09:10:28.364542 tst mo_mt_call_osmux.py: using RAC 22 09:10:28.481395 tst mo_mt_call_osmux.py: using CellId 20422 09:10:28.599132 tst mo_mt_call_osmux.py: using BVCI 20423 09:10:28.709713 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:28.720816 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:28.732055 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:28.743141 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:28.754369 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:10:28.765446 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:28.883372 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:10:29.003253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:29.469421 run create_hlr_db(pid=18837): Launched 09:10:29.591154 bus /sierra_2: Setting Powered False 09:10:30.651108 run create_hlr_db(pid=18837): Terminated: ok {rc=0} 09:10:31.133871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18839): Launched 09:10:31.455480 run osmo-hlr_10.42.42.2(pid=18840): Launched 09:10:31.687285 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:32.262449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18842): Launched 09:10:32.572156 run osmo-stp_10.42.42.5(pid=18843): Launched 09:10:32.687014 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:33.232720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18845): Launched 09:10:33.533056 run osmo-msc_10.42.42.6(pid=18846): Launched 09:10:33.701367 run osmo-stp_10.42.42.5(pid=18843): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18843)] 09:10:33.828384 run osmo-stp_10.42.42.5(pid=18843): stdout: | (launched: 2022-12-09_09:10:32.515866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:33.955491 run osmo-stp_10.42.42.5(pid=18843): stderr: | [0;m[38;5;43m20221209091032683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091032684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091032684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091032684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091032685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091032685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091032685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:34.079983 run osmo-stp_10.42.42.5(pid=18843): stdout: | (launched: 2022-12-09_09:10:32.515866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:34.199316 run osmo-stp_10.42.42.5(pid=18843): stderr: | [0;m[38;5;43m20221209091032683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091032684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091032684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091032684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091032685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091032685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091032685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:34.342305 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18843): Process ended prematurely: osmo-stp_10.42.42.5(pid=18843) [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18843)] [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:10:34.351473 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:10:34.377732 run osmo-hlr_10.42.42.2(pid=18840): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18840)] 09:10:34.424808 run osmo-hlr_10.42.42.2(pid=18840): stdout: | (launched: 2022-12-09_09:10:31.396150) 09:10:34.474012 run osmo-hlr_10.42.42.2(pid=18840): stderr: | [0;m[1;31m20221209091031747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091031747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091031747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091031747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091031747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091031747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091031775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091031792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091031792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091031792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:34.542248 run osmo-msc_10.42.42.6(pid=18846): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18846)] 09:10:34.589398 run osmo-msc_10.42.42.6(pid=18846): stdout: | (launched: 2022-12-09_09:10:33.477733) 09:10:34.638452 run osmo-msc_10.42.42.6(pid=18846): stderr: | [0;m[38;5;43m20221209091033747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091033747 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f24359a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091033747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091033747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091033747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091033747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091033749 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091033750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091033751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091033751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:34.687276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18839): Terminating (SIGTERM) 09:10:34.726485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18842): Terminating (SIGTERM) 09:10:34.766402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18845): Terminating (SIGTERM) 09:10:34.806222 --- ParallelTerminationStrategy: PID 18839 died... 09:10:34.824902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18839): Terminated: ok {rc=0} 09:10:34.868470 --- ParallelTerminationStrategy: PID 18842 died... 09:10:34.886925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18842): Terminated: ok {rc=0} 09:10:34.929962 --- ParallelTerminationStrategy: PID 18845 died... 09:10:34.948336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18845): Terminated: ok {rc=0} 09:10:35.031181 bus /sierra_3: Setting Powered False 09:10:36.128442 bus /sierra_3: Setting Powered False 09:10:37.245064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:10:38.497253 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:38.502698 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:10:38.535761 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:10:38.562894 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:10:38.616206 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:10:38.649498 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:10:38.675974 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:10:39.225932 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:10:39.273944 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:39.285145 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:10:39.358605 tst mo_mt_call.py: using LAC 20423 09:10:39.476012 tst mo_mt_call.py: using RAC 23 09:10:39.591934 tst mo_mt_call.py: using CellId 20423 09:10:39.707589 tst mo_mt_call.py: using BVCI 20424 09:10:39.815672 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:39.826721 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:39.837519 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:39.848170 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:39.858903 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:39.869627 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:10:39.988574 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:10:40.106603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:40.570242 run create_hlr_db(pid=18854): Launched 09:10:40.692900 bus /sierra_2: Setting Powered False 09:10:41.753246 run create_hlr_db(pid=18854): Terminated: ok {rc=0} 09:10:42.188300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18856): Launched 09:10:42.486946 run osmo-hlr_10.42.42.2(pid=18857): Launched 09:10:42.601295 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:43.115325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18859): Launched 09:10:43.414090 run osmo-stp_10.42.42.5(pid=18860): Launched 09:10:43.527300 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:44.068549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18862): Launched 09:10:44.369181 run osmo-msc_10.42.42.6(pid=18863): Launched 09:10:44.536504 run osmo-stp_10.42.42.5(pid=18860): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18860)] 09:10:44.664487 run osmo-stp_10.42.42.5(pid=18860): stdout: | (launched: 2022-12-09_09:10:43.359062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:44.791844 run osmo-stp_10.42.42.5(pid=18860): stderr: | [0;m[38;5;43m20221209091043524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091043524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091043524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091043525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091043525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091043525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091043525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:44.916285 run osmo-stp_10.42.42.5(pid=18860): stdout: | (launched: 2022-12-09_09:10:43.359062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:45.035712 run osmo-stp_10.42.42.5(pid=18860): stderr: | [0;m[38;5;43m20221209091043524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091043524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091043524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091043525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091043525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091043525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091043525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:45.178579 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18860): Process ended prematurely: osmo-stp_10.42.42.5(pid=18860) [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18860)] [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:10:45.187316 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 09:10:45.213360 run osmo-hlr_10.42.42.2(pid=18857): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18857)] 09:10:45.260462 run osmo-hlr_10.42.42.2(pid=18857): stdout: | (launched: 2022-12-09_09:10:42.431933) 09:10:45.309198 run osmo-hlr_10.42.42.2(pid=18857): stderr: | [0;m[1;31m20221209091042605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091042605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091042605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091042605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091042605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091042605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091042618 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091042626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091042627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091042627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:45.378017 run osmo-msc_10.42.42.6(pid=18863): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18863)] 09:10:45.425059 run osmo-msc_10.42.42.6(pid=18863): stdout: | (launched: 2022-12-09_09:10:44.313189) 09:10:45.473520 run osmo-msc_10.42.42.6(pid=18863): stderr: | [0;m[38;5;43m20221209091044582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091044582 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe766454c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091044582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091044582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091044582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091044583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091044584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091044585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091044585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091044585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:45.522484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18856): Terminating (SIGTERM) 09:10:45.561448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18859): Terminating (SIGTERM) 09:10:45.600467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18862): Terminating (SIGTERM) 09:10:45.639722 --- ParallelTerminationStrategy: PID 18856 died... 09:10:45.658451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18856): Terminated: ok {rc=0} 09:10:45.701837 --- ParallelTerminationStrategy: PID 18859 died... 09:10:45.720039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18859): Terminated: ok {rc=0} 09:10:45.763255 --- ParallelTerminationStrategy: PID 18862 died... 09:10:45.781614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18862): Terminated: ok {rc=0} 09:10:45.877480 bus /sierra_3: Setting Powered False 09:10:46.978654 bus /sierra_3: Setting Powered False 09:10:48.100282 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:10:49.248303 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:49.260622 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:10:49.334809 tst mo_mt_call_osmux.py: using LAC 20424 09:10:49.461458 tst mo_mt_call_osmux.py: using RAC 24 09:10:49.593450 tst mo_mt_call_osmux.py: using CellId 20424 09:10:49.710857 tst mo_mt_call_osmux.py: using BVCI 20425 09:10:49.820470 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:49.831535 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:49.842471 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:49.853427 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:49.864413 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:10:49.875250 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:10:49.995248 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:10:50.111735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:50.575774 run create_hlr_db(pid=18865): Launched 09:10:50.697804 bus /sierra_2: Setting Powered False 09:10:51.757284 run create_hlr_db(pid=18865): Terminated: ok {rc=0} 09:10:52.195231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18867): Launched 09:10:52.517478 run osmo-hlr_10.42.42.2(pid=18868): Launched 09:10:52.642311 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:53.193080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18870): Launched 09:10:53.512832 run osmo-stp_10.42.42.5(pid=18871): Launched 09:10:53.636265 run osmo-msc_10.42.42.6: Starting osmo-msc 09:10:54.215320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18873): Launched 09:10:54.537103 run osmo-msc_10.42.42.6(pid=18874): Launched 09:10:54.717942 run osmo-stp_10.42.42.5(pid=18871): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18871)] 09:10:54.853784 run osmo-stp_10.42.42.5(pid=18871): stdout: | (launched: 2022-12-09_09:10:53.454213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:54.989855 run osmo-stp_10.42.42.5(pid=18871): stderr: | [0;m[38;5;43m20221209091053643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091053643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091053643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091053643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091053644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091053644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091053644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:55.123524 run osmo-stp_10.42.42.5(pid=18871): stdout: | (launched: 2022-12-09_09:10:53.454213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:55.251648 run osmo-stp_10.42.42.5(pid=18871): stderr: | [0;m[38;5;43m20221209091053643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091053643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091053643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091053643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091053644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091053644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091053644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:55.404918 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18871): Process ended prematurely: osmo-stp_10.42.42.5(pid=18871) [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18871)] [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:10:55.414685 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:10:55.443381 run osmo-hlr_10.42.42.2(pid=18868): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18868)] 09:10:55.493562 run osmo-hlr_10.42.42.2(pid=18868): stdout: | (launched: 2022-12-09_09:10:52.458816) 09:10:55.545600 run osmo-hlr_10.42.42.2(pid=18868): stderr: | [0;m[1;31m20221209091052652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091052652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091052653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091052653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091052653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091052653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091052665 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091052673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091052674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091052674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:55.618271 run osmo-msc_10.42.42.6(pid=18874): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18874)] 09:10:55.668320 run osmo-msc_10.42.42.6(pid=18874): stdout: | (launched: 2022-12-09_09:10:54.478229) 09:10:55.719880 run osmo-msc_10.42.42.6(pid=18874): stderr: | [0;m[38;5;43m20221209091054797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091054797 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd428020c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091054797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091054797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091054798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091054798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091054799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091054800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091054800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091054800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:10:55.772004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18867): Terminating (SIGTERM) 09:10:55.813968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18870): Terminating (SIGTERM) 09:10:55.855882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18873): Terminating (SIGTERM) 09:10:55.898112 --- ParallelTerminationStrategy: PID 18867 died... 09:10:55.918003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18867): Terminated: ok {rc=0} 09:10:55.964508 --- ParallelTerminationStrategy: PID 18870 died... 09:10:55.984015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18870): Terminated: ok {rc=0} 09:10:56.030649 --- ParallelTerminationStrategy: PID 18873 died... 09:10:56.050430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18873): Terminated: ok {rc=0} 09:10:56.139429 bus /sierra_3: Setting Powered False 09:10:57.239079 bus /sierra_3: Setting Powered False 09:10:58.354613 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:trx-lms --------------------------------------------------------------------- 09:10:59.611345 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:59.616467 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 09:10:59.649830 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:10:59.676727 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 09:10:59.762498 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 09:10:59.795832 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:10:59.822861 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 09:11:00.407192 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 09:11:00.412074 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:00.422860 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:11:00.471877 tst emergency_mo_mt_call.py: using LAC 20425 09:11:00.586626 tst emergency_mo_mt_call.py: using RAC 25 09:11:00.714229 tst emergency_mo_mt_call.py: using CellId 20425 09:11:00.841363 tst emergency_mo_mt_call.py: using BVCI 20426 09:11:00.966803 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:00.978111 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:00.989084 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:01.000069 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:01.011089 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:01.022095 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:11:01.145680 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:11:01.267036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:01.817932 run create_hlr_db(pid=18879): Launched 09:11:01.954938 bus /sierra_2: Setting Powered False 09:11:03.017480 run create_hlr_db(pid=18879): Terminated: ok {rc=0} 09:11:03.439916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18881): Launched 09:11:03.735408 run osmo-hlr_10.42.42.2(pid=18882): Launched 09:11:03.847469 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:04.366077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18884): Launched 09:11:04.660363 run osmo-stp_10.42.42.5(pid=18885): Launched 09:11:04.781324 tst emergency_mo_mt_call.py: using MSISDN 7127 09:11:04.930159 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:05.459768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18887): Launched 09:11:05.755140 run osmo-msc_10.42.42.6(pid=18888): Launched 09:11:05.919184 run osmo-stp_10.42.42.5(pid=18885): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18885)] 09:11:06.043428 run osmo-stp_10.42.42.5(pid=18885): stdout: | (launched: 2022-12-09_09:11:04.605858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:06.167392 run osmo-stp_10.42.42.5(pid=18885): stderr: | [0;m[38;5;43m20221209091104773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091104773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091104773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091104775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091104775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091104775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091104775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:06.290109 run osmo-stp_10.42.42.5(pid=18885): stdout: | (launched: 2022-12-09_09:11:04.605858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:06.407253 run osmo-stp_10.42.42.5(pid=18885): stderr: | [0;m[38;5;43m20221209091104773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091104773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091104773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091104775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091104775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091104775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091104775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:06.546886 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18885): Process ended prematurely: osmo-stp_10.42.42.5(pid=18885) [trial-2357↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18885)] [trial-2357↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 09:11:06.555168 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 09:11:06.580812 run osmo-hlr_10.42.42.2(pid=18882): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18882)] 09:11:06.628091 run osmo-hlr_10.42.42.2(pid=18882): stdout: | (launched: 2022-12-09_09:11:03.680913) 09:11:06.676757 run osmo-hlr_10.42.42.2(pid=18882): stderr: | [0;m[1;31m20221209091103853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091103853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091103853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091103853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091103853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091103853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091103866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091103875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091103875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091103875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:06.744794 run osmo-msc_10.42.42.6(pid=18888): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18888)] 09:11:06.791951 run osmo-msc_10.42.42.6(pid=18888): stdout: | (launched: 2022-12-09_09:11:05.700299) 09:11:06.840667 run osmo-msc_10.42.42.6(pid=18888): stderr: | [0;m[38;5;43m20221209091105970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091105970 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcfb5222c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091105970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091105971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091105971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091105971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091105973 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091105973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091105973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091105973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:06.889796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18881): Terminating (SIGTERM) 09:11:06.928893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18884): Terminating (SIGTERM) 09:11:06.968164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18887): Terminating (SIGTERM) 09:11:07.007636 --- ParallelTerminationStrategy: PID 18881 died... 09:11:07.026640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18881): Terminated: ok {rc=0} 09:11:07.070234 --- ParallelTerminationStrategy: PID 18884 died... 09:11:07.088513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18884): Terminated: ok {rc=0} 09:11:07.131944 --- ParallelTerminationStrategy: PID 18887 died... 09:11:07.150418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18887): Terminated: ok {rc=0} 09:11:07.233160 bus /sierra_3: Setting Powered False 09:11:08.329896 bus /sierra_3: Setting Powered False 09:11:09.447399 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 09:11:10.533576 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:10.544754 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:11:10.595935 tst emergency_preemptive_call.py: using LAC 20426 09:11:10.713213 tst emergency_preemptive_call.py: using RAC 26 09:11:10.828434 tst emergency_preemptive_call.py: using CellId 20426 09:11:10.943913 tst emergency_preemptive_call.py: using BVCI 20427 09:11:11.050337 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:11.061127 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:11.071720 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:11.082377 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:11.092867 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:11:11.103426 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:11:11.220166 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:11:11.339574 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:11:11.455505 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:11:11.573946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:12.031749 run create_hlr_db(pid=18891): Launched 09:11:12.152873 bus /sierra_2: Setting Powered False 09:11:13.212147 run create_hlr_db(pid=18891): Terminated: ok {rc=0} 09:11:13.624653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18893): Launched 09:11:13.919537 run osmo-hlr_10.42.42.2(pid=18894): Launched 09:11:14.030407 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:14.549508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18896): Launched 09:11:14.844761 run osmo-stp_10.42.42.5(pid=18897): Launched 09:11:14.970187 tst emergency_preemptive_call.py: using MSISDN 7128 09:11:15.120411 run osmo-msc_10.42.42.6: Starting osmo-msc 09:11:15.648149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18899): Launched 09:11:15.975214 run osmo-msc_10.42.42.6(pid=18900): Launched 09:11:16.327322 run osmo-stp_10.42.42.5(pid=18897): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18897)] 09:11:16.625816 run osmo-stp_10.42.42.5(pid=18897): stdout: | (launched: 2022-12-09_09:11:14.790206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:16.750683 run osmo-stp_10.42.42.5(pid=18897): stderr: | [0;m[38;5;43m20221209091114956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091114956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091114956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091114957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091114957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091114957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091114957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:16.879280 run osmo-stp_10.42.42.5(pid=18897): stdout: | (launched: 2022-12-09_09:11:14.790206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:17.008487 run osmo-stp_10.42.42.5(pid=18897): stderr: | [0;m[38;5;43m20221209091114956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091114956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091114956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091114957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091114957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091114957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091114957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:17.163207 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18897): Process ended prematurely: osmo-stp_10.42.42.5(pid=18897) [trial-2357↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18897)] [trial-2357↪emergency:trx-lms↪emergency_preemptive_call.py:32] 09:11:17.173356 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 09:11:17.202555 run osmo-hlr_10.42.42.2(pid=18894): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18894)] 09:11:17.253302 run osmo-hlr_10.42.42.2(pid=18894): stdout: | (launched: 2022-12-09_09:11:13.864859) 09:11:17.305826 run osmo-hlr_10.42.42.2(pid=18894): stderr: | [0;m[1;31m20221209091114038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091114038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091114038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091114038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091114038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091114038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091114050 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091114061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091114061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091114062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:17.378800 run osmo-msc_10.42.42.6(pid=18900): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18900)] 09:11:17.429552 run osmo-msc_10.42.42.6(pid=18900): stdout: | (launched: 2022-12-09_09:11:15.913870) 09:11:17.481820 run osmo-msc_10.42.42.6(pid=18900): stderr: | [0;m[38;5;43m20221209091116417 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091116417 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fefd6657c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091116417 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091116417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091116417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091116418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091116419 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091116420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091116420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091116420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:11:17.534571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18893): Terminating (SIGTERM) 09:11:17.576709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18896): Terminating (SIGTERM) 09:11:17.619029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18899): Terminating (SIGTERM) 09:11:17.661332 --- ParallelTerminationStrategy: PID 18893 died... 09:11:17.681549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18893): Terminated: ok {rc=0} 09:11:17.728148 --- ParallelTerminationStrategy: PID 18896 died... 09:11:17.747839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18896): Terminated: ok {rc=0} 09:11:17.794644 --- ParallelTerminationStrategy: PID 18899 died... 09:11:17.814278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18899): Terminated: ok {rc=0} 09:11:17.902579 bus /sierra_9: Setting Powered False 09:11:19.001519 bus /sierra_9: Setting Powered False 09:11:20.120083 bus /sierra_8: Setting Powered False 09:11:21.218781 bus /sierra_8: Setting Powered False 09:11:22.334112 bus /sierra_3: Setting Powered False 09:11:23.432627 bus /sierra_3: Setting Powered False 09:11:24.549083 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms --------------------------------------------------------------------- 09:11:25.833181 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:11:25.837703 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 09:11:25.872680 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 09:11:25.913210 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 09:11:26.003573 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 09:11:26.038262 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 09:11:26.078653 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 09:11:26.670922 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 09:11:26.723449 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:26.734599 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:11:26.788411 tst cs_paging_gprs_active.py: using LAC 20427 09:11:26.914110 tst cs_paging_gprs_active.py: using RAC 27 09:11:27.037745 tst cs_paging_gprs_active.py: using CellId 20427 09:11:27.161149 tst cs_paging_gprs_active.py: using BVCI 20428 09:11:27.277721 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.288806 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.299788 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.311128 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.322312 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.333473 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.344697 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.355901 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:27.367219 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:11:27.488316 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:11:27.608268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:11:27.826433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:28.149511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18905): Launched 09:11:28.428650 run iperf3-srv_10.42.42.10(pid=18906): Launched 09:11:28.549696 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:11:28.766842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:29.090273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18907): Launched 09:11:29.370494 run iperf3-srv_10.42.42.10(pid=18908): Launched 09:11:29.490990 tst cs_paging_gprs_active.py:38: start network... 09:11:29.708768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:30.207330 run create_hlr_db(pid=18909): Launched 09:11:30.331269 bus /sierra_2: Setting Powered False 09:11:31.395385 run create_hlr_db(pid=18909): Terminated: ok {rc=0} 09:11:31.859387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18911): Launched 09:11:32.225299 run osmo-hlr_10.42.42.2(pid=18912): Launched 09:11:32.348925 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:32.904583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18914): Launched 09:11:33.226023 run osmo-stp_10.42.42.5(pid=18915): Launched 09:11:33.348270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:33.903413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18917): Launched 09:11:34.027145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:34.298895 run patchelf(pid=18918): Launched 09:11:34.477031 run osmo-stp_10.42.42.5(pid=18915): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18915)] 09:11:34.612663 run osmo-stp_10.42.42.5(pid=18915): stdout: | (launched: 2022-12-09_09:11:33.167201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:34.750238 run osmo-stp_10.42.42.5(pid=18915): stderr: | [0;m[38;5;43m20221209091133354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091133354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091133354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091133354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091133355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091133355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091133355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:34.887461 run osmo-stp_10.42.42.5(pid=18915): stdout: | (launched: 2022-12-09_09:11:33.167201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:35.018955 run osmo-stp_10.42.42.5(pid=18915): stderr: | [0;m[38;5;43m20221209091133354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091133354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091133354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091133354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091133355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091133355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091133355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:35.175009 run patchelf(pid=18918): Terminating (SIGINT) 09:11:35.354691 run patchelf(pid=18918): Terminated: ok {rc=0} 09:11:35.484063 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18915): Process ended prematurely: osmo-stp_10.42.42.5(pid=18915) [trial-2357↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18915)] [trial-2357↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 09:11:35.494252 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:11:35.523047 run osmo-hlr_10.42.42.2(pid=18912): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18912)] 09:11:35.572560 run osmo-hlr_10.42.42.2(pid=18912): stdout: | (launched: 2022-12-09_09:11:32.164556) 09:11:35.623974 run osmo-hlr_10.42.42.2(pid=18912): stderr: | [0;m[1;31m20221209091132358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091132358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091132358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091132358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091132359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091132359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091132372 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091132382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091132382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091132382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:35.676376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18905): Terminating (SIGTERM) 09:11:35.718058 run iperf3-srv_10.42.42.10(pid=18906): Terminating (SIGTERM) 09:11:35.759624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18907): Terminating (SIGTERM) 09:11:35.801368 run iperf3-srv_10.42.42.10(pid=18908): Terminating (SIGTERM) 09:11:35.842714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18911): Terminating (SIGTERM) 09:11:35.884277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18914): Terminating (SIGTERM) 09:11:35.926150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18917): Terminating (SIGTERM) 09:11:35.967865 --- ParallelTerminationStrategy: PID 18905 died... 09:11:35.987458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18905): Terminated: ok {rc=0} 09:11:36.033721 --- ParallelTerminationStrategy: PID 18906 died... 09:11:36.053030 run iperf3-srv_10.42.42.10(pid=18906): Terminated {rc=256} 09:11:36.099015 --- ParallelTerminationStrategy: PID 18907 died... 09:11:36.118460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18907): Terminated: ok {rc=0} 09:11:36.164218 --- ParallelTerminationStrategy: PID 18908 died... 09:11:36.183570 run iperf3-srv_10.42.42.10(pid=18908): Terminated {rc=256} 09:11:36.229906 --- ParallelTerminationStrategy: PID 18911 died... 09:11:36.249256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18911): Terminated: ok {rc=0} 09:11:36.295131 --- ParallelTerminationStrategy: PID 18914 died... 09:11:36.314494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18914): Terminated: ok {rc=0} 09:11:36.360626 --- ParallelTerminationStrategy: PID 18917 died... 09:11:36.380113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18917): Terminated: ok {rc=0} 09:11:36.467535 bus /gobi_0: Setting Powered False 09:11:37.566447 bus /gobi_0: Setting Powered False 09:11:38.681825 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms iperf3.py ---------------------------------------------- 09:11:39.829623 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:39.841353 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:11:39.898538 tst iperf3.py: using LAC 20428 09:11:40.024924 tst iperf3.py: using RAC 28 09:11:40.149162 tst iperf3.py: using CellId 20428 09:11:40.272816 tst iperf3.py: using BVCI 20429 09:11:40.389730 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.400743 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.411743 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.422948 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.434046 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.445271 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.456355 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.467431 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:40.478709 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:11:40.594924 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:11:40.796529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:41.098199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18919): Launched 09:11:41.359962 run iperf3-srv_10.42.42.10(pid=18920): Launched 09:11:41.472509 tst iperf3.py:8: start network... 09:11:41.673814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:42.141949 run create_hlr_db(pid=18921): Launched 09:11:42.265447 bus /gobi_6: Setting Powered False 09:11:43.325379 run create_hlr_db(pid=18921): Terminated: ok {rc=0} 09:11:43.764424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18923): Launched 09:11:44.086963 run osmo-hlr_10.42.42.2(pid=18924): Launched 09:11:44.210594 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:44.767470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18926): Launched 09:11:45.090372 run osmo-stp_10.42.42.5(pid=18927): Launched 09:11:45.214168 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:45.769640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18929): Launched 09:11:45.896543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:46.177543 run patchelf(pid=18930): Launched 09:11:46.371563 run osmo-stp_10.42.42.5(pid=18927): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18927)] 09:11:46.511908 run osmo-stp_10.42.42.5(pid=18927): stdout: | (launched: 2022-12-09_09:11:45.031374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:46.654012 run osmo-stp_10.42.42.5(pid=18927): stderr: | [0;m[38;5;43m20221209091145220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091145220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091145220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091145221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091145221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091145221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091145221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:46.795801 run osmo-stp_10.42.42.5(pid=18927): stdout: | (launched: 2022-12-09_09:11:45.031374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:46.931806 run osmo-stp_10.42.42.5(pid=18927): stderr: | [0;m[38;5;43m20221209091145220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091145220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091145220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091145221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091145221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091145221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091145221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:47.092288 run patchelf(pid=18930): Terminating (SIGINT) 09:11:47.276327 run patchelf(pid=18930): Terminated: ok {rc=0} 09:11:47.406449 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18927): Process ended prematurely: osmo-stp_10.42.42.5(pid=18927) [trial-2357↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18927)] [trial-2357↪gprs:trx-lms↪iperf3.py:8] 09:11:47.416469 tst iperf3.py:8: Test FAILED (7.6 sec) 09:11:47.445616 run osmo-hlr_10.42.42.2(pid=18924): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18924)] 09:11:47.495864 run osmo-hlr_10.42.42.2(pid=18924): stdout: | (launched: 2022-12-09_09:11:44.028181) 09:11:47.547599 run osmo-hlr_10.42.42.2(pid=18924): stderr: | [0;m[1;31m20221209091144222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091144222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091144222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091144222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091144222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091144222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091144234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091144242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091144242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091144243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:47.599693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18919): Terminating (SIGTERM) 09:11:47.641913 run iperf3-srv_10.42.42.10(pid=18920): Terminating (SIGTERM) 09:11:47.683592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18923): Terminating (SIGTERM) 09:11:47.725445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18926): Terminating (SIGTERM) 09:11:47.766986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18929): Terminating (SIGTERM) 09:11:47.808999 --- ParallelTerminationStrategy: PID 18919 died... 09:11:47.828909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18919): Terminated: ok {rc=0} 09:11:47.875334 --- ParallelTerminationStrategy: PID 18920 died... 09:11:47.894700 run iperf3-srv_10.42.42.10(pid=18920): Terminated {rc=256} 09:11:47.940639 --- ParallelTerminationStrategy: PID 18923 died... 09:11:47.960088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18923): Terminated: ok {rc=0} 09:11:48.006507 --- ParallelTerminationStrategy: PID 18926 died... 09:11:48.025913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18926): Terminated: ok {rc=0} 09:11:48.071805 --- ParallelTerminationStrategy: PID 18929 died... 09:11:48.091288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18929): Terminated: ok {rc=0} 09:11:48.178559 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms iperf3m4.py ---------------------------------------------- 09:11:49.327708 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.339442 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:11:49.390079 tst iperf3m4.py: using LAC 20429 09:11:49.517685 tst iperf3m4.py: using RAC 29 09:11:49.637988 tst iperf3m4.py: using CellId 20429 09:11:49.757750 tst iperf3m4.py: using BVCI 20430 09:11:49.867970 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.878928 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.889721 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.900748 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.912015 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.923182 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.934439 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.945467 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:11:49.956665 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:11:50.077658 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:11:50.204844 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:11:50.321942 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:11:50.441971 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:11:50.659938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:50.982278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18931): Launched 09:11:51.261930 run iperf3-srv_10.42.42.10(pid=18932): Launched 09:11:51.382641 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:11:51.599334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:51.923211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18933): Launched 09:11:52.203212 run iperf3-srv_10.42.42.10(pid=18934): Launched 09:11:52.323512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:11:52.540230 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:52.863375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18935): Launched 09:11:53.142321 run iperf3-srv_10.42.42.10(pid=18936): Launched 09:11:53.262398 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:11:53.479265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:53.802697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18937): Launched 09:11:54.082406 run iperf3-srv_10.42.42.10(pid=18938): Launched 09:11:54.202509 tst iperf3m4.py:8: start network... 09:11:54.419128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:54.921368 run create_hlr_db(pid=18939): Launched 09:11:55.043709 bus /gobi_6: Setting Powered False 09:11:56.107019 run create_hlr_db(pid=18939): Terminated: ok {rc=0} 09:11:56.554057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18941): Launched 09:11:56.877430 run osmo-hlr_10.42.42.2(pid=18942): Launched 09:11:57.001999 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:57.555648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18944): Launched 09:11:57.877996 run osmo-stp_10.42.42.5(pid=18945): Launched 09:11:58.001417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:58.556105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18947): Launched 09:11:58.679447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:58.950836 run patchelf(pid=18948): Launched 09:11:59.130912 run osmo-stp_10.42.42.5(pid=18945): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18945)] 09:11:59.268025 run osmo-stp_10.42.42.5(pid=18945): stdout: | (launched: 2022-12-09_09:11:57.819094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:59.406793 run osmo-stp_10.42.42.5(pid=18945): stderr: | [0;m[38;5;43m20221209091158006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091158006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091158007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091158007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091158008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091158008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091158008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:59.545541 run osmo-stp_10.42.42.5(pid=18945): stdout: | (launched: 2022-12-09_09:11:57.819094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:59.679093 run osmo-stp_10.42.42.5(pid=18945): stderr: | [0;m[38;5;43m20221209091158006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091158006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091158007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091158007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091158008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091158008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091158008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:59.836477 run patchelf(pid=18948): Terminating (SIGINT) 09:12:00.018626 run patchelf(pid=18948): Terminated: ok {rc=0} 09:12:00.149595 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18945): Process ended prematurely: osmo-stp_10.42.42.5(pid=18945) [trial-2357↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18945)] [trial-2357↪gprs:trx-lms↪iperf3m4.py:8] 09:12:00.159695 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:12:00.188613 run osmo-hlr_10.42.42.2(pid=18942): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18942)] 09:12:00.238954 run osmo-hlr_10.42.42.2(pid=18942): stdout: | (launched: 2022-12-09_09:11:56.818322) 09:12:00.290757 run osmo-hlr_10.42.42.2(pid=18942): stderr: | [0;m[1;31m20221209091157012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091157012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091157012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091157012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091157012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091157012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091157027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091157035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091157035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091157036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:00.343146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18931): Terminating (SIGTERM) 09:12:00.384860 run iperf3-srv_10.42.42.10(pid=18932): Terminating (SIGTERM) 09:12:00.426233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18933): Terminating (SIGTERM) 09:12:00.467897 run iperf3-srv_10.42.42.10(pid=18934): Terminating (SIGTERM) 09:12:00.509303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18935): Terminating (SIGTERM) 09:12:00.550959 run iperf3-srv_10.42.42.10(pid=18936): Terminating (SIGTERM) 09:12:00.592295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18937): Terminating (SIGTERM) 09:12:00.633637 run iperf3-srv_10.42.42.10(pid=18938): Terminating (SIGTERM) 09:12:00.675291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18941): Terminating (SIGTERM) 09:12:00.716835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18944): Terminating (SIGTERM) 09:12:00.758353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18947): Terminating (SIGTERM) 09:12:00.799922 --- ParallelTerminationStrategy: PID 18931 died... 09:12:00.819740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18931): Terminated: ok {rc=0} 09:12:00.869249 --- ParallelTerminationStrategy: PID 18932 died... 09:12:00.889537 run iperf3-srv_10.42.42.10(pid=18932): Terminated {rc=256} 09:12:00.936912 --- ParallelTerminationStrategy: PID 18933 died... 09:12:00.956853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18933): Terminated: ok {rc=0} 09:12:01.004377 --- ParallelTerminationStrategy: PID 18934 died... 09:12:01.024450 run iperf3-srv_10.42.42.10(pid=18934): Terminated {rc=256} 09:12:01.071264 --- ParallelTerminationStrategy: PID 18935 died... 09:12:01.091232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18935): Terminated: ok {rc=0} 09:12:01.138661 --- ParallelTerminationStrategy: PID 18936 died... 09:12:01.158792 run iperf3-srv_10.42.42.10(pid=18936): Terminated {rc=256} 09:12:01.205684 --- ParallelTerminationStrategy: PID 18937 died... 09:12:01.225370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18937): Terminated: ok {rc=0} 09:12:01.272580 --- ParallelTerminationStrategy: PID 18938 died... 09:12:01.292637 run iperf3-srv_10.42.42.10(pid=18938): Terminated {rc=256} 09:12:01.339887 --- ParallelTerminationStrategy: PID 18941 died... 09:12:01.359969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18941): Terminated: ok {rc=0} 09:12:01.406615 --- ParallelTerminationStrategy: PID 18944 died... 09:12:01.426415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18944): Terminated: ok {rc=0} 09:12:01.473414 --- ParallelTerminationStrategy: PID 18947 died... 09:12:01.493458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18947): Terminated: ok {rc=0} 09:12:01.583797 bus /gobi_4: Setting Powered False 09:12:02.682927 bus /gobi_4: Setting Powered False 09:12:03.800179 bus /gobi_1: Setting Powered False 09:12:04.898364 bus /gobi_1: Setting Powered False 09:12:06.014546 bus /gobi_0: Setting Powered False 09:12:07.112632 bus /gobi_0: Setting Powered False 09:12:08.228674 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms ping.py ---------------------------------------------- 09:12:09.332058 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.343483 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:12:09.394442 tst ping.py: using LAC 20430 09:12:09.512756 tst ping.py: using RAC 30 09:12:09.629340 tst ping.py: using CellId 20430 09:12:09.746202 tst ping.py: using BVCI 20431 09:12:09.853913 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.864597 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.875284 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.885944 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.896463 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.906926 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.917481 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:09.927952 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:12:10.043097 tst ping.py:19: start network... 09:12:10.241692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:10.704305 run create_hlr_db(pid=18949): Launched 09:12:10.826569 bus /gobi_6: Setting Powered False 09:12:11.886774 run create_hlr_db(pid=18949): Terminated: ok {rc=0} 09:12:12.323603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18951): Launched 09:12:12.643771 run osmo-hlr_10.42.42.2(pid=18952): Launched 09:12:12.767380 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:13.321123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18954): Launched 09:12:13.641540 run osmo-stp_10.42.42.5(pid=18955): Launched 09:12:13.765566 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:14.318866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18957): Launched 09:12:14.442420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:14.712915 run patchelf(pid=18958): Launched 09:12:14.890575 run osmo-stp_10.42.42.5(pid=18955): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18955)] 09:12:15.026443 run osmo-stp_10.42.42.5(pid=18955): stdout: | (launched: 2022-12-09_09:12:13.582687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:15.163758 run osmo-stp_10.42.42.5(pid=18955): stderr: | [0;m[38;5;43m20221209091213773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091213773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091213774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091213774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091213775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091213775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091213775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:15.301329 run osmo-stp_10.42.42.5(pid=18955): stdout: | (launched: 2022-12-09_09:12:13.582687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:15.433169 run osmo-stp_10.42.42.5(pid=18955): stderr: | [0;m[38;5;43m20221209091213773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091213773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091213774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091213774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091213775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091213775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091213775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:15.589233 run patchelf(pid=18958): Terminating (SIGINT) 09:12:15.768493 run patchelf(pid=18958): Terminated: ok {rc=0} 09:12:15.916391 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18955): Process ended prematurely: osmo-stp_10.42.42.5(pid=18955) [trial-2357↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18955)] [trial-2357↪gprs:trx-lms↪ping.py:22] 09:12:15.926789 tst ping.py:22: Test FAILED (6.6 sec) 09:12:15.956492 run osmo-hlr_10.42.42.2(pid=18952): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18952)] 09:12:16.008410 run osmo-hlr_10.42.42.2(pid=18952): stdout: | (launched: 2022-12-09_09:12:12.585177) 09:12:16.062025 run osmo-hlr_10.42.42.2(pid=18952): stderr: | [0;m[1;31m20221209091212779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091212779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091212779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091212779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091212779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091212780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091212795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091212805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091212805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091212805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:16.117132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18951): Terminating (SIGTERM) 09:12:16.161448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18954): Terminating (SIGTERM) 09:12:16.206342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18957): Terminating (SIGTERM) 09:12:16.252672 --- ParallelTerminationStrategy: PID 18951 died... 09:12:16.273809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18951): Terminated: ok {rc=0} 09:12:16.324543 --- ParallelTerminationStrategy: PID 18954 died... 09:12:16.345318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18954): Terminated: ok {rc=0} 09:12:16.394634 --- ParallelTerminationStrategy: PID 18957 died... 09:12:16.415251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18957): Terminated: ok {rc=0} 09:12:16.506669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 09:12:17.594840 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:17.606281 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:12:17.660465 tst ping_idle_ping.py: using LAC 20431 09:12:17.777415 tst ping_idle_ping.py: using RAC 31 09:12:17.902349 tst ping_idle_ping.py: using CellId 20431 09:12:18.026406 tst ping_idle_ping.py: using BVCI 20432 09:12:18.143022 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:18.154353 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:18.165594 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:18.176820 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:18.188118 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:18.199250 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:18.210546 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:12:18.221933 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:12:18.340333 tst ping_idle_ping.py:24: start network... 09:12:18.542753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:19.011666 run create_hlr_db(pid=18959): Launched 09:12:19.135228 bus /gobi_6: Setting Powered False 09:12:20.195436 run create_hlr_db(pid=18959): Terminated: ok {rc=0} 09:12:20.635776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18961): Launched 09:12:20.958649 run osmo-hlr_10.42.42.2(pid=18962): Launched 09:12:21.083336 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:21.635662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18964): Launched 09:12:21.957847 run osmo-stp_10.42.42.5(pid=18965): Launched 09:12:22.081527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:22.634813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18967): Launched 09:12:22.759687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:23.030532 run patchelf(pid=18968): Launched 09:12:23.209704 run osmo-stp_10.42.42.5(pid=18965): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18965)] 09:12:23.344934 run osmo-stp_10.42.42.5(pid=18965): stdout: | (launched: 2022-12-09_09:12:21.898821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:23.481849 run osmo-stp_10.42.42.5(pid=18965): stderr: | [0;m[38;5;43m20221209091222086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091222086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091222086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091222087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091222087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091222087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091222087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:23.618533 run osmo-stp_10.42.42.5(pid=18965): stdout: | (launched: 2022-12-09_09:12:21.898821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:23.750470 run osmo-stp_10.42.42.5(pid=18965): stderr: | [0;m[38;5;43m20221209091222086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091222086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091222086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091222087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091222087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091222087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091222087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:23.905960 run patchelf(pid=18968): Terminating (SIGINT) 09:12:24.085113 run patchelf(pid=18968): Terminated: ok {rc=0} 09:12:24.214390 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18965): Process ended prematurely: osmo-stp_10.42.42.5(pid=18965) [trial-2357↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18965)] [trial-2357↪gprs:trx-lms↪ping_idle_ping.py:27] 09:12:24.223948 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:12:24.252574 run osmo-hlr_10.42.42.2(pid=18962): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18962)] 09:12:24.302272 run osmo-hlr_10.42.42.2(pid=18962): stdout: | (launched: 2022-12-09_09:12:20.899852) 09:12:24.353878 run osmo-hlr_10.42.42.2(pid=18962): stderr: | [0;m[1;31m20221209091221094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091221094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091221094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091221094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091221094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091221094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091221109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091221118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091221118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091221118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:24.405906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18961): Terminating (SIGTERM) 09:12:24.447782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18964): Terminating (SIGTERM) 09:12:24.489736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18967): Terminating (SIGTERM) 09:12:24.531776 --- ParallelTerminationStrategy: PID 18961 died... 09:12:24.551631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18961): Terminated: ok {rc=0} 09:12:24.598036 --- ParallelTerminationStrategy: PID 18964 died... 09:12:24.617410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18964): Terminated: ok {rc=0} 09:12:24.664017 --- ParallelTerminationStrategy: PID 18967 died... 09:12:24.683475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18967): Terminated: ok {rc=0} 09:12:24.770918 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 09:12:26.074961 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:12:26.080362 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:12:26.115751 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:12:26.156266 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:12:26.245594 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:12:26.279407 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:12:26.318732 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:12:26.913690 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:12:26.963635 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:26.974721 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:12:27.026608 tst cs_paging_gprs_active.py: using LAC 20432 09:12:27.148807 tst cs_paging_gprs_active.py: using RAC 32 09:12:27.275941 tst cs_paging_gprs_active.py: using CellId 20432 09:12:27.399261 tst cs_paging_gprs_active.py: using BVCI 20433 09:12:27.512837 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.523976 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.534744 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.546174 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.557412 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.568739 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.580237 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.591452 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:27.602899 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:12:27.725971 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:12:27.844679 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:12:28.051857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:28.360881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18973): Launched 09:12:28.627708 run iperf3-srv_10.42.42.10(pid=18974): Launched 09:12:28.742742 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:12:28.947722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:29.255877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18975): Launched 09:12:29.522560 run iperf3-srv_10.42.42.10(pid=18976): Launched 09:12:29.638579 tst cs_paging_gprs_active.py:38: start network... 09:12:29.843791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:30.318433 run create_hlr_db(pid=18977): Launched 09:12:30.444294 bus /gobi_6: Setting Powered False 09:12:31.526737 run create_hlr_db(pid=18977): Terminated: ok {rc=0} 09:12:31.982905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18979): Launched 09:12:32.304665 run osmo-hlr_10.42.42.2(pid=18980): Launched 09:12:32.420481 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:32.961269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18982): Launched 09:12:33.267649 run osmo-stp_10.42.42.5(pid=18983): Launched 09:12:33.384101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:33.911524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18985): Launched 09:12:34.028290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:34.287782 run patchelf(pid=18986): Launched 09:12:34.461245 run osmo-stp_10.42.42.5(pid=18983): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18983)] 09:12:34.590872 run osmo-stp_10.42.42.5(pid=18983): stdout: | (launched: 2022-12-09_09:12:33.210704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:34.721642 run osmo-stp_10.42.42.5(pid=18983): stderr: | [0;m[38;5;43m20221209091233382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091233382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091233382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091233383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091233383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091233383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091233383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:34.852730 run osmo-stp_10.42.42.5(pid=18983): stdout: | (launched: 2022-12-09_09:12:33.210704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:34.977778 run osmo-stp_10.42.42.5(pid=18983): stderr: | [0;m[38;5;43m20221209091233382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091233382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091233382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091233383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091233383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091233383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091233383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:35.126596 run patchelf(pid=18986): Terminating (SIGINT) 09:12:35.297991 run patchelf(pid=18986): Terminated: ok {rc=0} 09:12:35.421258 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18983): Process ended prematurely: osmo-stp_10.42.42.5(pid=18983) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18983)] [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:12:35.430761 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:12:35.457917 run osmo-hlr_10.42.42.2(pid=18980): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18980)] 09:12:35.505494 run osmo-hlr_10.42.42.2(pid=18980): stdout: | (launched: 2022-12-09_09:12:32.248394) 09:12:35.555012 run osmo-hlr_10.42.42.2(pid=18980): stderr: | [0;m[1;31m20221209091232423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091232423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091232423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091232423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091232423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091232423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091232435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091232445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091232445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091232445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:35.604662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18973): Terminating (SIGTERM) 09:12:35.644380 run iperf3-srv_10.42.42.10(pid=18974): Terminating (SIGTERM) 09:12:35.684130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18975): Terminating (SIGTERM) 09:12:35.723957 run iperf3-srv_10.42.42.10(pid=18976): Terminating (SIGTERM) 09:12:35.763428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18979): Terminating (SIGTERM) 09:12:35.803375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18982): Terminating (SIGTERM) 09:12:35.843118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18985): Terminating (SIGTERM) 09:12:35.882943 --- ParallelTerminationStrategy: PID 18973 died... 09:12:35.902030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18973): Terminated: ok {rc=0} 09:12:35.946084 --- ParallelTerminationStrategy: PID 18974 died... 09:12:35.964548 run iperf3-srv_10.42.42.10(pid=18974): Terminated {rc=256} 09:12:36.008644 --- ParallelTerminationStrategy: PID 18975 died... 09:12:36.027402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18975): Terminated: ok {rc=0} 09:12:36.071588 --- ParallelTerminationStrategy: PID 18976 died... 09:12:36.090350 run iperf3-srv_10.42.42.10(pid=18976): Terminated {rc=256} 09:12:36.134256 --- ParallelTerminationStrategy: PID 18979 died... 09:12:36.152878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18979): Terminated: ok {rc=0} 09:12:36.197501 --- ParallelTerminationStrategy: PID 18982 died... 09:12:36.216459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18982): Terminated: ok {rc=0} 09:12:36.260897 --- ParallelTerminationStrategy: PID 18985 died... 09:12:36.279710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18985): Terminated: ok {rc=0} 09:12:36.364031 bus /gobi_0: Setting Powered False 09:12:37.462519 bus /gobi_0: Setting Powered False 09:12:38.579984 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:12:39.725286 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:39.736899 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:12:39.788664 tst iperf3.py: using LAC 20433 09:12:39.909933 tst iperf3.py: using RAC 33 09:12:40.029935 tst iperf3.py: using CellId 20433 09:12:40.150579 tst iperf3.py: using BVCI 20434 09:12:40.263672 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.274814 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.285696 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.296503 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.307320 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.318065 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.328890 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.339727 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:40.350704 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:12:40.469648 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:12:40.691136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:41.019206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18992): Launched 09:12:41.305048 run iperf3-srv_10.42.42.10(pid=18993): Launched 09:12:41.427687 tst iperf3.py:8: start network... 09:12:41.648552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:42.154983 run create_hlr_db(pid=18994): Launched 09:12:42.279394 bus /gobi_6: Setting Powered False 09:12:43.343221 run create_hlr_db(pid=18994): Terminated: ok {rc=0} 09:12:43.782012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18996): Launched 09:12:44.087307 run osmo-hlr_10.42.42.2(pid=18997): Launched 09:12:44.204079 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:44.734541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18999): Launched 09:12:45.039814 run osmo-stp_10.42.42.5(pid=19000): Launched 09:12:45.156639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:45.683156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19002): Launched 09:12:45.799037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:46.072847 run patchelf(pid=19003): Launched 09:12:46.276362 run osmo-stp_10.42.42.5(pid=19000): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19000)] 09:12:46.407959 run osmo-stp_10.42.42.5(pid=19000): stdout: | (launched: 2022-12-09_09:12:44.983198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:46.541082 run osmo-stp_10.42.42.5(pid=19000): stderr: | [0;m[38;5;43m20221209091245152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091245153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091245153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091245153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091245154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091245154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091245154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:46.673928 run osmo-stp_10.42.42.5(pid=19000): stdout: | (launched: 2022-12-09_09:12:44.983198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:46.801438 run osmo-stp_10.42.42.5(pid=19000): stderr: | [0;m[38;5;43m20221209091245152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091245153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091245153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091245153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091245154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091245154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091245154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:46.955742 run patchelf(pid=19003): Terminating (SIGINT) 09:12:47.164630 run patchelf(pid=19003): Terminated: ok {rc=0} 09:12:47.290998 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19000): Process ended prematurely: osmo-stp_10.42.42.5(pid=19000) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19000)] [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 09:12:47.301618 tst iperf3.py:8: Test FAILED (7.6 sec) 09:12:47.330068 run osmo-hlr_10.42.42.2(pid=18997): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18997)] 09:12:47.378633 run osmo-hlr_10.42.42.2(pid=18997): stdout: | (launched: 2022-12-09_09:12:44.031311) 09:12:47.428723 run osmo-hlr_10.42.42.2(pid=18997): stderr: | [0;m[1;31m20221209091244207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091244207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091244207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091244207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091244207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091244207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091244219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091244228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091244228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091244228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:47.478408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18992): Terminating (SIGTERM) 09:12:47.518161 run iperf3-srv_10.42.42.10(pid=18993): Terminating (SIGTERM) 09:12:47.557694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18996): Terminating (SIGTERM) 09:12:47.597357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18999): Terminating (SIGTERM) 09:12:47.637163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19002): Terminating (SIGTERM) 09:12:47.677729 --- ParallelTerminationStrategy: PID 18992 died... 09:12:47.697032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18992): Terminated: ok {rc=0} 09:12:47.741586 --- ParallelTerminationStrategy: PID 18993 died... 09:12:47.760056 run iperf3-srv_10.42.42.10(pid=18993): Terminated {rc=256} 09:12:47.804166 --- ParallelTerminationStrategy: PID 18996 died... 09:12:47.822942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18996): Terminated: ok {rc=0} 09:12:47.867086 --- ParallelTerminationStrategy: PID 18999 died... 09:12:47.885741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18999): Terminated: ok {rc=0} 09:12:47.929667 --- ParallelTerminationStrategy: PID 19002 died... 09:12:47.948411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19002): Terminated: ok {rc=0} 09:12:48.033002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:12:49.182150 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.194426 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:12:49.249100 tst iperf3m4.py: using LAC 20434 09:12:49.377431 tst iperf3m4.py: using RAC 34 09:12:49.498460 tst iperf3m4.py: using CellId 20434 09:12:49.618354 tst iperf3m4.py: using BVCI 20435 09:12:49.730880 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.742105 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.753070 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.763963 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.774597 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.785301 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.796101 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.806803 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:12:49.817628 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:12:49.937550 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:12:50.062055 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:12:50.179529 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:12:50.295696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:12:50.501724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:50.807778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19004): Launched 09:12:51.073749 run iperf3-srv_10.42.42.10(pid=19005): Launched 09:12:51.187679 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:12:51.392072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:51.698765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Launched 09:12:51.965097 run iperf3-srv_10.42.42.10(pid=19007): Launched 09:12:52.080350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:12:52.284734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:52.591012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Launched 09:12:52.855915 run iperf3-srv_10.42.42.10(pid=19009): Launched 09:12:52.969611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:12:53.173138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:53.479400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19010): Launched 09:12:53.744728 run iperf3-srv_10.42.42.10(pid=19011): Launched 09:12:53.858758 tst iperf3m4.py:8: start network... 09:12:54.062696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:54.537347 run create_hlr_db(pid=19012): Launched 09:12:54.662212 bus /gobi_6: Setting Powered False 09:12:55.722648 run create_hlr_db(pid=19012): Terminated: ok {rc=0} 09:12:56.168165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19014): Launched 09:12:56.496434 run osmo-hlr_10.42.42.2(pid=19015): Launched 09:12:56.622775 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:57.183980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19017): Launched 09:12:57.509925 run osmo-stp_10.42.42.5(pid=19018): Launched 09:12:57.637149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:58.201128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19020): Launched 09:12:58.327220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:58.603672 run patchelf(pid=19021): Launched 09:12:58.785703 run osmo-stp_10.42.42.5(pid=19018): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19018)] 09:12:58.924798 run osmo-stp_10.42.42.5(pid=19018): stdout: | (launched: 2022-12-09_09:12:57.450280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:59.064187 run osmo-stp_10.42.42.5(pid=19018): stderr: | [0;m[38;5;43m20221209091257638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091257638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091257638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091257639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091257639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091257640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091257640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:59.203937 run osmo-stp_10.42.42.5(pid=19018): stdout: | (launched: 2022-12-09_09:12:57.450280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:59.337941 run osmo-stp_10.42.42.5(pid=19018): stderr: | [0;m[38;5;43m20221209091257638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091257638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091257638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091257639 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091257639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091257640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091257640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:59.496710 run patchelf(pid=19021): Terminating (SIGINT) 09:12:59.679893 run patchelf(pid=19021): Terminated: ok {rc=0} 09:12:59.811861 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19018): Process ended prematurely: osmo-stp_10.42.42.5(pid=19018) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19018)] [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 09:12:59.822111 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:12:59.851429 run osmo-hlr_10.42.42.2(pid=19015): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19015)] 09:12:59.902195 run osmo-hlr_10.42.42.2(pid=19015): stdout: | (launched: 2022-12-09_09:12:56.436322) 09:12:59.954600 run osmo-hlr_10.42.42.2(pid=19015): stderr: | [0;m[1;31m20221209091256632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091256632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091256632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091256632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091256632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091256633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091256645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091256654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091256654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091256654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:00.007430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19004): Terminating (SIGTERM) 09:13:00.049903 run iperf3-srv_10.42.42.10(pid=19005): Terminating (SIGTERM) 09:13:00.092315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Terminating (SIGTERM) 09:13:00.134997 run iperf3-srv_10.42.42.10(pid=19007): Terminating (SIGTERM) 09:13:00.178550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Terminating (SIGTERM) 09:13:00.221034 run iperf3-srv_10.42.42.10(pid=19009): Terminating (SIGTERM) 09:13:00.263520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19010): Terminating (SIGTERM) 09:13:00.305929 run iperf3-srv_10.42.42.10(pid=19011): Terminating (SIGTERM) 09:13:00.347882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19014): Terminating (SIGTERM) 09:13:00.390684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19017): Terminating (SIGTERM) 09:13:00.433191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19020): Terminating (SIGTERM) 09:13:00.475646 --- ParallelTerminationStrategy: PID 19004 died... 09:13:00.495808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19004): Terminated: ok {rc=0} 09:13:00.542631 --- ParallelTerminationStrategy: PID 19005 died... 09:13:00.562208 run iperf3-srv_10.42.42.10(pid=19005): Terminated {rc=256} 09:13:00.609150 --- ParallelTerminationStrategy: PID 19006 died... 09:13:00.628756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19006): Terminated: ok {rc=0} 09:13:00.675690 --- ParallelTerminationStrategy: PID 19007 died... 09:13:00.695236 run iperf3-srv_10.42.42.10(pid=19007): Terminated {rc=256} 09:13:00.742446 --- ParallelTerminationStrategy: PID 19008 died... 09:13:00.761972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19008): Terminated: ok {rc=0} 09:13:00.808537 --- ParallelTerminationStrategy: PID 19009 died... 09:13:00.828475 run iperf3-srv_10.42.42.10(pid=19009): Terminated {rc=256} 09:13:00.882992 --- ParallelTerminationStrategy: PID 19010 died... 09:13:00.902942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19010): Terminated: ok {rc=0} 09:13:00.962716 --- ParallelTerminationStrategy: PID 19011 died... 09:13:00.983012 run iperf3-srv_10.42.42.10(pid=19011): Terminated {rc=256} 09:13:01.044567 --- ParallelTerminationStrategy: PID 19014 died... 09:13:01.071205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19014): Terminated: ok {rc=0} 09:13:01.130918 --- ParallelTerminationStrategy: PID 19017 died... 09:13:01.156309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19017): Terminated: ok {rc=0} 09:13:01.216132 --- ParallelTerminationStrategy: PID 19020 died... 09:13:01.236851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19020): Terminated: ok {rc=0} 09:13:01.325205 bus /gobi_4: Setting Powered False 09:13:02.427447 bus /gobi_4: Setting Powered False 09:13:03.544617 bus /gobi_1: Setting Powered False 09:13:04.641165 bus /gobi_1: Setting Powered False 09:13:05.755607 bus /gobi_0: Setting Powered False 09:13:06.855480 bus /gobi_0: Setting Powered False 09:13:07.973169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 09:13:09.075417 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.087710 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:13:09.141772 tst ping.py: using LAC 20435 09:13:09.262289 tst ping.py: using RAC 35 09:13:09.382511 tst ping.py: using CellId 20435 09:13:09.502063 tst ping.py: using BVCI 20436 09:13:09.610718 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.621843 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.632707 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.644046 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.654879 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.665718 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.676681 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:09.687548 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:09.807341 tst ping.py:19: start network... 09:13:10.024308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:10.522494 run create_hlr_db(pid=19022): Launched 09:13:10.645448 bus /gobi_6: Setting Powered False 09:13:11.708598 run create_hlr_db(pid=19022): Terminated: ok {rc=0} 09:13:12.137481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19024): Launched 09:13:12.437718 run osmo-hlr_10.42.42.2(pid=19025): Launched 09:13:12.553541 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:13.085370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19027): Launched 09:13:13.384696 run osmo-stp_10.42.42.5(pid=19028): Launched 09:13:13.498957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:14.015953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19030): Launched 09:13:14.130523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:14.382927 run patchelf(pid=19031): Launched 09:13:14.549895 run osmo-stp_10.42.42.5(pid=19028): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19028)] 09:13:14.676544 run osmo-stp_10.42.42.5(pid=19028): stdout: | (launched: 2022-12-09_09:13:13.329354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:14.804565 run osmo-stp_10.42.42.5(pid=19028): stderr: | [0;m[38;5;43m20221209091313497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091313497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091313497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091313498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091313498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091313498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091313499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:14.932530 run osmo-stp_10.42.42.5(pid=19028): stdout: | (launched: 2022-12-09_09:13:13.329354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:15.055104 run osmo-stp_10.42.42.5(pid=19028): stderr: | [0;m[38;5;43m20221209091313497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091313497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091313497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091313498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091313498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091313498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091313499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:15.200171 run patchelf(pid=19031): Terminating (SIGINT) 09:13:15.367353 run patchelf(pid=19031): Terminated: ok {rc=0} 09:13:15.487932 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19028): Process ended prematurely: osmo-stp_10.42.42.5(pid=19028) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19028)] [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 09:13:15.496817 tst ping.py:22: Test FAILED (6.4 sec) 09:13:15.523561 run osmo-hlr_10.42.42.2(pid=19025): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19025)] 09:13:15.571133 run osmo-hlr_10.42.42.2(pid=19025): stdout: | (launched: 2022-12-09_09:13:12.382593) 09:13:15.620804 run osmo-hlr_10.42.42.2(pid=19025): stderr: | [0;m[1;31m20221209091312552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091312552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091312552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091312552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091312553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091312553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091312565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091312574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091312574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091312574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:15.670607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19024): Terminating (SIGTERM) 09:13:15.710585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19027): Terminating (SIGTERM) 09:13:15.750448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19030): Terminating (SIGTERM) 09:13:15.790654 --- ParallelTerminationStrategy: PID 19024 died... 09:13:15.809488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19024): Terminated: ok {rc=0} 09:13:15.860350 --- ParallelTerminationStrategy: PID 19027 died... 09:13:15.879792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19027): Terminated: ok {rc=0} 09:13:15.927478 --- ParallelTerminationStrategy: PID 19030 died... 09:13:15.951963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19030): Terminated: ok {rc=0} 09:13:16.049276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:13:17.137467 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.149539 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:13:17.206426 tst ping_idle_ping.py: using LAC 20436 09:13:17.326241 tst ping_idle_ping.py: using RAC 36 09:13:17.446049 tst ping_idle_ping.py: using CellId 20436 09:13:17.563746 tst ping_idle_ping.py: using BVCI 20437 09:13:17.673364 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.684424 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.695309 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.706298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.717060 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.727859 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.738867 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:13:17.749777 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:13:17.871428 tst ping_idle_ping.py:24: start network... 09:13:18.072509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:18.540166 run create_hlr_db(pid=19032): Launched 09:13:18.663203 bus /gobi_6: Setting Powered False 09:13:19.723530 run create_hlr_db(pid=19032): Terminated: ok {rc=0} 09:13:20.163004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19034): Launched 09:13:20.485613 run osmo-hlr_10.42.42.2(pid=19035): Launched 09:13:20.611186 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:21.163592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19037): Launched 09:13:21.486053 run osmo-stp_10.42.42.5(pid=19038): Launched 09:13:21.611178 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:22.167199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19040): Launched 09:13:22.291696 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:22.564485 run patchelf(pid=19041): Launched 09:13:22.743606 run osmo-stp_10.42.42.5(pid=19038): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19038)] 09:13:22.879666 run osmo-stp_10.42.42.5(pid=19038): stdout: | (launched: 2022-12-09_09:13:21.426841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:23.017295 run osmo-stp_10.42.42.5(pid=19038): stderr: | [0;m[38;5;43m20221209091321616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091321616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091321617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091321617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091321618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091321618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091321618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:23.154692 run osmo-stp_10.42.42.5(pid=19038): stdout: | (launched: 2022-12-09_09:13:21.426841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:23.286721 run osmo-stp_10.42.42.5(pid=19038): stderr: | [0;m[38;5;43m20221209091321616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091321616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091321617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091321617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091321618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091321618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091321618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:23.443091 run patchelf(pid=19041): Terminating (SIGINT) 09:13:23.622872 run patchelf(pid=19041): Terminated: ok {rc=0} 09:13:23.753031 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19038): Process ended prematurely: osmo-stp_10.42.42.5(pid=19038) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19038)] [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 09:13:23.762674 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:13:23.791498 run osmo-hlr_10.42.42.2(pid=19035): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19035)] 09:13:23.841773 run osmo-hlr_10.42.42.2(pid=19035): stdout: | (launched: 2022-12-09_09:13:20.426598) 09:13:23.893752 run osmo-hlr_10.42.42.2(pid=19035): stderr: | [0;m[1;31m20221209091320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091320634 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091320642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091320642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091320643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:23.946252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19034): Terminating (SIGTERM) 09:13:23.988398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19037): Terminating (SIGTERM) 09:13:24.030772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19040): Terminating (SIGTERM) 09:13:24.073711 --- ParallelTerminationStrategy: PID 19034 died... 09:13:24.093783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19034): Terminated: ok {rc=0} 09:13:24.140689 --- ParallelTerminationStrategy: PID 19037 died... 09:13:24.160577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19037): Terminated: ok {rc=0} 09:13:24.207487 --- ParallelTerminationStrategy: PID 19040 died... 09:13:24.227093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19040): Terminated: ok {rc=0} 09:13:24.315561 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:13:25.619370 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:25.625247 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:13:25.660200 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:13:25.699898 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:13:25.790207 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:13:25.824579 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:13:25.863904 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:13:26.457444 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:13:26.507643 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:26.518661 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:13:26.589445 tst cs_paging_gprs_active.py: using LAC 20437 09:13:26.714747 tst cs_paging_gprs_active.py: using RAC 37 09:13:26.834728 tst cs_paging_gprs_active.py: using CellId 20437 09:13:26.954670 tst cs_paging_gprs_active.py: using BVCI 20438 09:13:27.067500 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.078593 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.089377 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.100666 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.111829 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.123130 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.134504 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.145689 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:27.156922 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:13:27.280173 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:13:27.399092 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:13:27.606071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:27.915030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19045): Launched 09:13:28.181135 run iperf3-srv_10.42.42.10(pid=19046): Launched 09:13:28.295547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:13:28.500197 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:28.808277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19047): Launched 09:13:29.073304 run iperf3-srv_10.42.42.10(pid=19048): Launched 09:13:29.187065 tst cs_paging_gprs_active.py:38: start network... 09:13:29.391148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:29.863849 run create_hlr_db(pid=19049): Launched 09:13:29.987948 bus /gobi_6: Setting Powered False 09:13:31.069431 run create_hlr_db(pid=19049): Terminated: ok {rc=0} 09:13:31.604406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19051): Launched 09:13:31.928855 run osmo-hlr_10.42.42.2(pid=19052): Launched 09:13:32.104733 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:32.711548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19054): Launched 09:13:33.016215 run osmo-stp_10.42.42.5(pid=19055): Launched 09:13:33.132316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:33.656740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19057): Launched 09:13:33.772866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:34.036748 run patchelf(pid=19058): Launched 09:13:34.206976 run osmo-stp_10.42.42.5(pid=19055): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19055)] 09:13:34.336403 run osmo-stp_10.42.42.5(pid=19055): stdout: | (launched: 2022-12-09_09:13:32.959694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:34.467292 run osmo-stp_10.42.42.5(pid=19055): stderr: | [0;m[38;5;43m20221209091333129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091333129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091333129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091333129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091333130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091333130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091333130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:34.598224 run osmo-stp_10.42.42.5(pid=19055): stdout: | (launched: 2022-12-09_09:13:32.959694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:34.724529 run osmo-stp_10.42.42.5(pid=19055): stderr: | [0;m[38;5;43m20221209091333129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091333129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091333129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091333129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091333130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091333130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091333130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:34.873489 run patchelf(pid=19058): Terminating (SIGINT) 09:13:35.045084 run patchelf(pid=19058): Terminated: ok {rc=0} 09:13:35.168843 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19055): Process ended prematurely: osmo-stp_10.42.42.5(pid=19055) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19055)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:13:35.178469 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:13:35.205758 run osmo-hlr_10.42.42.2(pid=19052): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19052)] 09:13:35.253322 run osmo-hlr_10.42.42.2(pid=19052): stdout: | (launched: 2022-12-09_09:13:31.871021) 09:13:35.302381 run osmo-hlr_10.42.42.2(pid=19052): stderr: | [0;m[1;31m20221209091332217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091332217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091332218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091332218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091332218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091332218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091332246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091332262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091332262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091332262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:35.351975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19045): Terminating (SIGTERM) 09:13:35.391873 run iperf3-srv_10.42.42.10(pid=19046): Terminating (SIGTERM) 09:13:35.431678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19047): Terminating (SIGTERM) 09:13:35.471548 run iperf3-srv_10.42.42.10(pid=19048): Terminating (SIGTERM) 09:13:35.511114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19051): Terminating (SIGTERM) 09:13:35.550860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19054): Terminating (SIGTERM) 09:13:35.590540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19057): Terminating (SIGTERM) 09:13:35.630547 --- ParallelTerminationStrategy: PID 19045 died... 09:13:35.649679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19045): Terminated: ok {rc=0} 09:13:35.693617 --- ParallelTerminationStrategy: PID 19046 died... 09:13:35.711937 run iperf3-srv_10.42.42.10(pid=19046): Terminated {rc=256} 09:13:35.755801 --- ParallelTerminationStrategy: PID 19047 died... 09:13:35.774466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19047): Terminated: ok {rc=0} 09:13:35.818931 --- ParallelTerminationStrategy: PID 19048 died... 09:13:35.837636 run iperf3-srv_10.42.42.10(pid=19048): Terminated {rc=256} 09:13:35.881272 --- ParallelTerminationStrategy: PID 19051 died... 09:13:35.899870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19051): Terminated: ok {rc=0} 09:13:35.944027 --- ParallelTerminationStrategy: PID 19054 died... 09:13:35.962819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19054): Terminated: ok {rc=0} 09:13:36.006935 --- ParallelTerminationStrategy: PID 19057 died... 09:13:36.025794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19057): Terminated: ok {rc=0} 09:13:36.109510 bus /gobi_0: Setting Powered False 09:13:37.207280 bus /gobi_0: Setting Powered False 09:13:38.326416 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:13:39.476322 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:39.488637 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:13:39.562664 tst iperf3.py: using LAC 20438 09:13:39.692382 tst iperf3.py: using RAC 38 09:13:39.812364 tst iperf3.py: using CellId 20438 09:13:39.933369 tst iperf3.py: using BVCI 20439 09:13:40.043834 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.055030 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.065880 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.076815 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.088018 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.098822 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.109679 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.120331 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:40.131223 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:13:40.249870 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:13:40.470801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:40.799120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19059): Launched 09:13:41.084121 run iperf3-srv_10.42.42.10(pid=19060): Launched 09:13:41.207131 tst iperf3.py:8: start network... 09:13:41.428543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:41.936407 run create_hlr_db(pid=19061): Launched 09:13:42.061553 bus /gobi_6: Setting Powered False 09:13:43.125976 run create_hlr_db(pid=19061): Terminated: ok {rc=0} 09:13:43.579883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Launched 09:13:43.907754 run osmo-hlr_10.42.42.2(pid=19064): Launched 09:13:44.032242 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:44.590246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Launched 09:13:44.917943 run osmo-stp_10.42.42.5(pid=19067): Launched 09:13:45.044711 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:45.607405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19069): Launched 09:13:45.733787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:46.029865 run patchelf(pid=19070): Launched 09:13:46.236381 run osmo-stp_10.42.42.5(pid=19067): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] 09:13:46.368440 run osmo-stp_10.42.42.5(pid=19067): stdout: | (launched: 2022-12-09_09:13:44.858501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:46.528087 run osmo-stp_10.42.42.5(pid=19067): stderr: | [0;m[38;5;43m20221209091345047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091345047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091345047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091345047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091345048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091345048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091345048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:46.687920 run osmo-stp_10.42.42.5(pid=19067): stdout: | (launched: 2022-12-09_09:13:44.858501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:46.816871 run osmo-stp_10.42.42.5(pid=19067): stderr: | [0;m[38;5;43m20221209091345047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091345047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091345047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091345047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091345048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091345048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091345048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:46.969906 run patchelf(pid=19070): Terminating (SIGINT) 09:13:47.144508 run patchelf(pid=19070): Terminated: ok {rc=0} 09:13:47.271799 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19067): Process ended prematurely: osmo-stp_10.42.42.5(pid=19067) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 09:13:47.281652 tst iperf3.py:8: Test FAILED (7.8 sec) 09:13:47.308899 run osmo-hlr_10.42.42.2(pid=19064): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19064)] 09:13:47.356645 run osmo-hlr_10.42.42.2(pid=19064): stdout: | (launched: 2022-12-09_09:13:43.848128) 09:13:47.406023 run osmo-hlr_10.42.42.2(pid=19064): stderr: | [0;m[1;31m20221209091344044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091344044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091344044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091344044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091344044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091344044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091344058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091344066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091344067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091344067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:47.455989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19059): Terminating (SIGTERM) 09:13:47.495858 run iperf3-srv_10.42.42.10(pid=19060): Terminating (SIGTERM) 09:13:47.535727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Terminating (SIGTERM) 09:13:47.575966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Terminating (SIGTERM) 09:13:47.615545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19069): Terminating (SIGTERM) 09:13:47.655203 --- ParallelTerminationStrategy: PID 19059 died... 09:13:47.674419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19059): Terminated: ok {rc=0} 09:13:47.718668 --- ParallelTerminationStrategy: PID 19060 died... 09:13:47.737359 run iperf3-srv_10.42.42.10(pid=19060): Terminated {rc=256} 09:13:47.780925 --- ParallelTerminationStrategy: PID 19063 died... 09:13:47.799449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19063): Terminated: ok {rc=0} 09:13:47.843132 --- ParallelTerminationStrategy: PID 19066 died... 09:13:47.861843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19066): Terminated: ok {rc=0} 09:13:47.905626 --- ParallelTerminationStrategy: PID 19069 died... 09:13:47.924529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19069): Terminated: ok {rc=0} 09:13:48.010828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:13:49.158303 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.170234 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:13:49.244848 tst iperf3m4.py: using LAC 20439 09:13:49.365447 tst iperf3m4.py: using RAC 39 09:13:49.486031 tst iperf3m4.py: using CellId 20439 09:13:49.605375 tst iperf3m4.py: using BVCI 20440 09:13:49.716730 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.728023 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.738876 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.750378 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.761656 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.773130 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.784580 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.795859 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:13:49.807373 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:13:49.929256 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:13:50.053665 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:13:50.171594 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:13:50.295235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:13:50.516939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:50.846944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19071): Launched 09:13:51.131911 run iperf3-srv_10.42.42.10(pid=19072): Launched 09:13:51.255310 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:13:51.476527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:51.805940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19073): Launched 09:13:52.092604 run iperf3-srv_10.42.42.10(pid=19074): Launched 09:13:52.215285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:13:52.435722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:52.764745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19075): Launched 09:13:53.049695 run iperf3-srv_10.42.42.10(pid=19076): Launched 09:13:53.173432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:13:53.393199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:13:53.720910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19077): Launched 09:13:54.007888 run iperf3-srv_10.42.42.10(pid=19078): Launched 09:13:54.131784 tst iperf3m4.py:8: start network... 09:13:54.352609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:54.862272 run create_hlr_db(pid=19079): Launched 09:13:54.986988 bus /gobi_6: Setting Powered False 09:13:56.051324 run create_hlr_db(pid=19079): Terminated: ok {rc=0} 09:13:56.487016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19081): Launched 09:13:56.792068 run osmo-hlr_10.42.42.2(pid=19082): Launched 09:13:56.908577 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:57.433694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19084): Launched 09:13:57.737442 run osmo-stp_10.42.42.5(pid=19085): Launched 09:13:57.853699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:58.377666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19087): Launched 09:13:58.493809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:58.751786 run patchelf(pid=19088): Launched 09:13:58.921739 run osmo-stp_10.42.42.5(pid=19085): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19085)] 09:13:59.050226 run osmo-stp_10.42.42.5(pid=19085): stdout: | (launched: 2022-12-09_09:13:57.681546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:59.180374 run osmo-stp_10.42.42.5(pid=19085): stderr: | [0;m[38;5;43m20221209091357848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091357848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091357848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091357849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091357849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091357850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091357850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:59.310658 run osmo-stp_10.42.42.5(pid=19085): stdout: | (launched: 2022-12-09_09:13:57.681546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:59.435645 run osmo-stp_10.42.42.5(pid=19085): stderr: | [0;m[38;5;43m20221209091357848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091357848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091357848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091357849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091357849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091357850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091357850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:59.583414 run patchelf(pid=19088): Terminating (SIGINT) 09:13:59.754037 run patchelf(pid=19088): Terminated: ok {rc=0} 09:13:59.876835 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19085): Process ended prematurely: osmo-stp_10.42.42.5(pid=19085) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19085)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:13:59.886527 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:13:59.914028 run osmo-hlr_10.42.42.2(pid=19082): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19082)] 09:13:59.961817 run osmo-hlr_10.42.42.2(pid=19082): stdout: | (launched: 2022-12-09_09:13:56.736026) 09:14:00.011223 run osmo-hlr_10.42.42.2(pid=19082): stderr: | [0;m[1;31m20221209091356913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091356913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091356913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091356913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091356913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091356913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091356925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091356935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091356935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091356935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:00.061176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19071): Terminating (SIGTERM) 09:14:00.101317 run iperf3-srv_10.42.42.10(pid=19072): Terminating (SIGTERM) 09:14:00.141403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19073): Terminating (SIGTERM) 09:14:00.181501 run iperf3-srv_10.42.42.10(pid=19074): Terminating (SIGTERM) 09:14:00.221520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19075): Terminating (SIGTERM) 09:14:00.261448 run iperf3-srv_10.42.42.10(pid=19076): Terminating (SIGTERM) 09:14:00.301169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19077): Terminating (SIGTERM) 09:14:00.341227 run iperf3-srv_10.42.42.10(pid=19078): Terminating (SIGTERM) 09:14:00.381247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19081): Terminating (SIGTERM) 09:14:00.421733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19084): Terminating (SIGTERM) 09:14:00.461928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19087): Terminating (SIGTERM) 09:14:00.502135 --- ParallelTerminationStrategy: PID 19071 died... 09:14:00.521339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19071): Terminated: ok {rc=0} 09:14:00.565875 --- ParallelTerminationStrategy: PID 19072 died... 09:14:00.584810 run iperf3-srv_10.42.42.10(pid=19072): Terminated {rc=256} 09:14:00.629466 --- ParallelTerminationStrategy: PID 19073 died... 09:14:00.648262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19073): Terminated: ok {rc=0} 09:14:00.692574 --- ParallelTerminationStrategy: PID 19074 died... 09:14:00.711419 run iperf3-srv_10.42.42.10(pid=19074): Terminated {rc=256} 09:14:00.755547 --- ParallelTerminationStrategy: PID 19075 died... 09:14:00.774371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19075): Terminated: ok {rc=0} 09:14:00.818630 --- ParallelTerminationStrategy: PID 19076 died... 09:14:00.837449 run iperf3-srv_10.42.42.10(pid=19076): Terminated {rc=256} 09:14:00.893612 --- ParallelTerminationStrategy: PID 19077 died... 09:14:00.915137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19077): Terminated: ok {rc=0} 09:14:00.960602 --- ParallelTerminationStrategy: PID 19078 died... 09:14:00.980251 run iperf3-srv_10.42.42.10(pid=19078): Terminated {rc=256} 09:14:01.029632 --- ParallelTerminationStrategy: PID 19081 died... 09:14:01.050583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19081): Terminated: ok {rc=0} 09:14:01.101435 --- ParallelTerminationStrategy: PID 19084 died... 09:14:01.122257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19084): Terminated: ok {rc=0} 09:14:01.172901 --- ParallelTerminationStrategy: PID 19087 died... 09:14:01.193913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19087): Terminated: ok {rc=0} 09:14:01.287054 bus /gobi_4: Setting Powered False 09:14:02.387917 bus /gobi_4: Setting Powered False 09:14:03.504724 bus /gobi_1: Setting Powered False 09:14:04.599718 bus /gobi_1: Setting Powered False 09:14:05.715060 bus /gobi_0: Setting Powered False 09:14:06.813985 bus /gobi_0: Setting Powered False 09:14:07.931506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:14:09.033178 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.045270 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:14:09.117365 tst ping.py: using LAC 20440 09:14:09.236772 tst ping.py: using RAC 40 09:14:09.354266 tst ping.py: using CellId 20440 09:14:09.473349 tst ping.py: using BVCI 20441 09:14:09.581938 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.593153 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.604069 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.615166 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.626185 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.637273 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.648433 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:09.659536 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:09.778833 tst ping.py:19: start network... 09:14:09.993998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:10.490391 run create_hlr_db(pid=19089): Launched 09:14:10.615129 bus /gobi_6: Setting Powered False 09:14:11.678773 run create_hlr_db(pid=19089): Terminated: ok {rc=0} 09:14:12.124386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19091): Launched 09:14:12.445210 run osmo-hlr_10.42.42.2(pid=19092): Launched 09:14:12.569635 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:13.129166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19094): Launched 09:14:13.450498 run osmo-stp_10.42.42.5(pid=19095): Launched 09:14:13.574659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:14.127481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19097): Launched 09:14:14.251806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:14.523293 run patchelf(pid=19098): Launched 09:14:14.702690 run osmo-stp_10.42.42.5(pid=19095): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19095)] 09:14:14.838785 run osmo-stp_10.42.42.5(pid=19095): stdout: | (launched: 2022-12-09_09:14:13.391606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:14.975855 run osmo-stp_10.42.42.5(pid=19095): stderr: | [0;m[38;5;43m20221209091413580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091413580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091413581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091413581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091413582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091413582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091413582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:15.113833 run osmo-stp_10.42.42.5(pid=19095): stdout: | (launched: 2022-12-09_09:14:13.391606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:15.245407 run osmo-stp_10.42.42.5(pid=19095): stderr: | [0;m[38;5;43m20221209091413580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091413580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091413581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091413581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091413582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091413582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091413582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:15.401548 run patchelf(pid=19098): Terminating (SIGINT) 09:14:15.580755 run patchelf(pid=19098): Terminated: ok {rc=0} 09:14:15.710234 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19095): Process ended prematurely: osmo-stp_10.42.42.5(pid=19095) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19095)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 09:14:15.719864 tst ping.py:22: Test FAILED (6.7 sec) 09:14:15.749264 run osmo-hlr_10.42.42.2(pid=19092): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19092)] 09:14:15.799542 run osmo-hlr_10.42.42.2(pid=19092): stdout: | (launched: 2022-12-09_09:14:12.386299) 09:14:15.859959 run osmo-hlr_10.42.42.2(pid=19092): stderr: | [0;m[1;31m20221209091412582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091412582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091412582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091412582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091412582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091412582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091412598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091412607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091412607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091412607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:15.913187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19091): Terminating (SIGTERM) 09:14:15.962189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19094): Terminating (SIGTERM) 09:14:16.006913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19097): Terminating (SIGTERM) 09:14:16.053277 --- ParallelTerminationStrategy: PID 19091 died... 09:14:16.073692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19091): Terminated: ok {rc=0} 09:14:16.121117 --- ParallelTerminationStrategy: PID 19094 died... 09:14:16.140847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19094): Terminated: ok {rc=0} 09:14:16.188240 --- ParallelTerminationStrategy: PID 19097 died... 09:14:16.208438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19097): Terminated: ok {rc=0} 09:14:16.297548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:14:17.384702 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:17.397094 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:14:17.473287 tst ping_idle_ping.py: using LAC 20441 09:14:17.592657 tst ping_idle_ping.py: using RAC 41 09:14:17.715695 tst ping_idle_ping.py: using CellId 20441 09:14:17.847225 tst ping_idle_ping.py: using BVCI 20442 09:14:17.965116 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:17.976775 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:17.988284 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:18.000514 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:18.012822 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:18.025096 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:18.038098 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:14:18.049612 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:14:18.174031 tst ping_idle_ping.py:24: start network... 09:14:18.390465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:18.892429 run create_hlr_db(pid=19099): Launched 09:14:19.015558 bus /gobi_6: Setting Powered False 09:14:20.079989 run create_hlr_db(pid=19099): Terminated: ok {rc=0} 09:14:20.511140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19101): Launched 09:14:20.812361 run osmo-hlr_10.42.42.2(pid=19102): Launched 09:14:20.930115 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:21.448464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Launched 09:14:21.749430 run osmo-stp_10.42.42.5(pid=19105): Launched 09:14:21.863855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:22.380572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19107): Launched 09:14:22.495294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:22.749291 run patchelf(pid=19108): Launched 09:14:22.916190 run osmo-stp_10.42.42.5(pid=19105): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19105)] 09:14:23.043411 run osmo-stp_10.42.42.5(pid=19105): stdout: | (launched: 2022-12-09_09:14:21.693589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:23.172912 run osmo-stp_10.42.42.5(pid=19105): stderr: | [0;m[38;5;43m20221209091421862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091421862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091421862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091421863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091421863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091421863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091421863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:23.302358 run osmo-stp_10.42.42.5(pid=19105): stdout: | (launched: 2022-12-09_09:14:21.693589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:23.425546 run osmo-stp_10.42.42.5(pid=19105): stderr: | [0;m[38;5;43m20221209091421862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091421862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091421862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091421863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091421863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091421863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091421863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:23.572015 run patchelf(pid=19108): Terminating (SIGINT) 09:14:23.740346 run patchelf(pid=19108): Terminated: ok {rc=0} 09:14:23.861649 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19105): Process ended prematurely: osmo-stp_10.42.42.5(pid=19105) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19105)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:14:23.870455 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:14:23.896891 run osmo-hlr_10.42.42.2(pid=19102): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19102)] 09:14:23.945076 run osmo-hlr_10.42.42.2(pid=19102): stdout: | (launched: 2022-12-09_09:14:20.756426) 09:14:23.994054 run osmo-hlr_10.42.42.2(pid=19102): stderr: | [0;m[1;31m20221209091420930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091420930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091420931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091420931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091420931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091420931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091420943 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091420951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091420951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091420951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:24.043423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19101): Terminating (SIGTERM) 09:14:24.083118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Terminating (SIGTERM) 09:14:24.122818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19107): Terminating (SIGTERM) 09:14:24.162801 --- ParallelTerminationStrategy: PID 19101 died... 09:14:24.182281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19101): Terminated: ok {rc=0} 09:14:24.226046 --- ParallelTerminationStrategy: PID 19104 died... 09:14:24.244535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Terminated: ok {rc=0} 09:14:24.289307 --- ParallelTerminationStrategy: PID 19107 died... 09:14:24.307926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19107): Terminated: ok {rc=0} 09:14:24.392330 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:14:25.698655 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:14:25.706378 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:14:25.743971 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:14:25.785223 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:14:25.876993 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:14:25.912466 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:14:25.953550 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:14:26.553653 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:14:26.606162 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:26.617403 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:14:26.690709 tst cs_paging_gprs_active.py: using LAC 20442 09:14:26.812642 tst cs_paging_gprs_active.py: using RAC 42 09:14:26.945837 tst cs_paging_gprs_active.py: using CellId 20442 09:14:27.074664 tst cs_paging_gprs_active.py: using BVCI 20443 09:14:27.196785 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.208278 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.219572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.231625 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.243693 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.255624 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.267712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.279741 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:27.292075 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:14:27.412766 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:14:27.535835 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:14:27.740470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:28.046939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19112): Launched 09:14:28.312132 run iperf3-srv_10.42.42.10(pid=19113): Launched 09:14:28.426600 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:14:28.631085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:28.938165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19114): Launched 09:14:29.206569 run iperf3-srv_10.42.42.10(pid=19115): Launched 09:14:29.323158 tst cs_paging_gprs_active.py:38: start network... 09:14:29.527153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:30.002842 run create_hlr_db(pid=19116): Launched 09:14:30.129649 bus /gobi_6: Setting Powered False 09:14:31.190419 run create_hlr_db(pid=19116): Terminated: ok {rc=0} 09:14:31.625629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19118): Launched 09:14:31.957719 run osmo-hlr_10.42.42.2(pid=19119): Launched 09:14:32.142767 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:32.757269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19121): Launched 09:14:33.063601 run osmo-stp_10.42.42.5(pid=19122): Launched 09:14:33.181066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:33.708600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19124): Launched 09:14:33.825726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:34.084551 run patchelf(pid=19125): Launched 09:14:34.256087 run osmo-stp_10.42.42.5(pid=19122): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19122)] 09:14:34.385777 run osmo-stp_10.42.42.5(pid=19122): stdout: | (launched: 2022-12-09_09:14:33.007234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:34.516797 run osmo-stp_10.42.42.5(pid=19122): stderr: | [0;m[38;5;43m20221209091433173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091433173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091433174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091433174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091433175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091433175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091433175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:34.647833 run osmo-stp_10.42.42.5(pid=19122): stdout: | (launched: 2022-12-09_09:14:33.007234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:34.773311 run osmo-stp_10.42.42.5(pid=19122): stderr: | [0;m[38;5;43m20221209091433173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091433173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091433174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091433174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091433175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091433175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091433175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:34.921947 run patchelf(pid=19125): Terminating (SIGINT) 09:14:35.092807 run patchelf(pid=19125): Terminated: ok {rc=0} 09:14:35.216817 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19122): Process ended prematurely: osmo-stp_10.42.42.5(pid=19122) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19122)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:14:35.226379 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:14:35.253629 run osmo-hlr_10.42.42.2(pid=19119): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19119)] 09:14:35.301464 run osmo-hlr_10.42.42.2(pid=19119): stdout: | (launched: 2022-12-09_09:14:31.893518) 09:14:35.350651 run osmo-hlr_10.42.42.2(pid=19119): stderr: | [0;m[1;31m20221209091432197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091432197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091432197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091432197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091432197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091432198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091432216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091432234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091432234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091432235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:35.400277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19112): Terminating (SIGTERM) 09:14:35.440037 run iperf3-srv_10.42.42.10(pid=19113): Terminating (SIGTERM) 09:14:35.479484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19114): Terminating (SIGTERM) 09:14:35.518953 run iperf3-srv_10.42.42.10(pid=19115): Terminating (SIGTERM) 09:14:35.558269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19118): Terminating (SIGTERM) 09:14:35.597891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19121): Terminating (SIGTERM) 09:14:35.637255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19124): Terminating (SIGTERM) 09:14:35.677046 --- ParallelTerminationStrategy: PID 19112 died... 09:14:35.696123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19112): Terminated: ok {rc=0} 09:14:35.740081 --- ParallelTerminationStrategy: PID 19113 died... 09:14:35.758779 run iperf3-srv_10.42.42.10(pid=19113): Terminated {rc=256} 09:14:35.802645 --- ParallelTerminationStrategy: PID 19114 died... 09:14:35.821500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19114): Terminated: ok {rc=0} 09:14:35.865167 --- ParallelTerminationStrategy: PID 19115 died... 09:14:35.883721 run iperf3-srv_10.42.42.10(pid=19115): Terminated {rc=256} 09:14:35.927388 --- ParallelTerminationStrategy: PID 19118 died... 09:14:35.945986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19118): Terminated: ok {rc=0} 09:14:35.989422 --- ParallelTerminationStrategy: PID 19121 died... 09:14:36.008033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19121): Terminated: ok {rc=0} 09:14:36.051656 --- ParallelTerminationStrategy: PID 19124 died... 09:14:36.070383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19124): Terminated: ok {rc=0} 09:14:36.155695 bus /gobi_0: Setting Powered False 09:14:37.254485 bus /gobi_0: Setting Powered False 09:14:38.370308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:14:39.516519 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:39.528246 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:14:39.599482 tst iperf3.py: using LAC 20443 09:14:39.720360 tst iperf3.py: using RAC 43 09:14:39.841836 tst iperf3.py: using CellId 20443 09:14:39.963180 tst iperf3.py: using BVCI 20444 09:14:40.075342 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.086466 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.097456 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.108345 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.119057 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.129845 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.140689 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.151473 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:40.162356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:14:40.277907 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:14:40.483032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:40.789105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19126): Launched 09:14:41.054390 run iperf3-srv_10.42.42.10(pid=19127): Launched 09:14:41.170203 tst iperf3.py:8: start network... 09:14:41.375116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:41.850068 run create_hlr_db(pid=19128): Launched 09:14:41.976778 bus /gobi_6: Setting Powered False 09:14:43.037974 run create_hlr_db(pid=19128): Terminated: ok {rc=0} 09:14:43.464061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19130): Launched 09:14:43.769956 run osmo-hlr_10.42.42.2(pid=19131): Launched 09:14:43.888709 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:44.414791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19133): Launched 09:14:44.719350 run osmo-stp_10.42.42.5(pid=19134): Launched 09:14:44.836041 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:45.363335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19136): Launched 09:14:45.479051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:45.736442 run patchelf(pid=19137): Launched 09:14:45.918078 run osmo-stp_10.42.42.5(pid=19134): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19134)] 09:14:46.083907 run osmo-stp_10.42.42.5(pid=19134): stdout: | (launched: 2022-12-09_09:14:44.663208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:46.217688 run osmo-stp_10.42.42.5(pid=19134): stderr: | [0;m[38;5;43m20221209091444832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091444832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091444832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091444833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091444833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091444834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091444834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:46.351446 run osmo-stp_10.42.42.5(pid=19134): stdout: | (launched: 2022-12-09_09:14:44.663208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:46.478894 run osmo-stp_10.42.42.5(pid=19134): stderr: | [0;m[38;5;43m20221209091444832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091444832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091444832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091444833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091444833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091444834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091444834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:46.629758 run patchelf(pid=19137): Terminating (SIGINT) 09:14:46.803692 run patchelf(pid=19137): Terminated: ok {rc=0} 09:14:46.929575 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19134): Process ended prematurely: osmo-stp_10.42.42.5(pid=19134) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19134)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 09:14:46.940056 tst iperf3.py:8: Test FAILED (7.5 sec) 09:14:46.968721 run osmo-hlr_10.42.42.2(pid=19131): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19131)] 09:14:47.017734 run osmo-hlr_10.42.42.2(pid=19131): stdout: | (launched: 2022-12-09_09:14:43.713395) 09:14:47.067849 run osmo-hlr_10.42.42.2(pid=19131): stderr: | [0;m[1;31m20221209091443888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091443888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091443888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091443888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091443888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091443888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091443901 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091443909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091443909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091443909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:47.118961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19126): Terminating (SIGTERM) 09:14:47.159524 run iperf3-srv_10.42.42.10(pid=19127): Terminating (SIGTERM) 09:14:47.199789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19130): Terminating (SIGTERM) 09:14:47.239579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19133): Terminating (SIGTERM) 09:14:47.279649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19136): Terminating (SIGTERM) 09:14:47.319501 --- ParallelTerminationStrategy: PID 19126 died... 09:14:47.338569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19126): Terminated: ok {rc=0} 09:14:47.382558 --- ParallelTerminationStrategy: PID 19127 died... 09:14:47.400922 run iperf3-srv_10.42.42.10(pid=19127): Terminated {rc=256} 09:14:47.444779 --- ParallelTerminationStrategy: PID 19130 died... 09:14:47.463572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19130): Terminated: ok {rc=0} 09:14:47.507371 --- ParallelTerminationStrategy: PID 19133 died... 09:14:47.526087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19133): Terminated: ok {rc=0} 09:14:47.569799 --- ParallelTerminationStrategy: PID 19136 died... 09:14:47.588586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19136): Terminated: ok {rc=0} 09:14:47.675129 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:14:48.822082 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:48.833887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:14:48.905757 tst iperf3m4.py: using LAC 20444 09:14:49.028109 tst iperf3m4.py: using RAC 44 09:14:49.150032 tst iperf3m4.py: using CellId 20444 09:14:49.271552 tst iperf3m4.py: using BVCI 20445 09:14:49.384152 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.395348 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.406293 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.417234 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.428013 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.438874 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.449981 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.460736 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:14:49.471753 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:14:49.589803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:14:49.712735 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:14:49.833140 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:14:49.949999 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:14:50.155854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:50.463114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19138): Launched 09:14:50.730450 run iperf3-srv_10.42.42.10(pid=19139): Launched 09:14:50.846773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:14:51.051371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:51.359803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19140): Launched 09:14:51.626613 run iperf3-srv_10.42.42.10(pid=19141): Launched 09:14:51.742878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:14:51.948125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:52.255460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19142): Launched 09:14:52.521705 run iperf3-srv_10.42.42.10(pid=19143): Launched 09:14:52.635555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:14:52.839998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:14:53.147311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19144): Launched 09:14:53.414219 run iperf3-srv_10.42.42.10(pid=19145): Launched 09:14:53.530727 tst iperf3m4.py:8: start network... 09:14:53.735869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:54.211352 run create_hlr_db(pid=19146): Launched 09:14:54.335798 bus /gobi_6: Setting Powered False 09:14:55.397518 run create_hlr_db(pid=19146): Terminated: ok {rc=0} 09:14:55.843937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19148): Launched 09:14:56.171793 run osmo-hlr_10.42.42.2(pid=19149): Launched 09:14:56.298827 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:56.862677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19151): Launched 09:14:57.190027 run osmo-stp_10.42.42.5(pid=19152): Launched 09:14:57.315844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:14:57.879066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19154): Launched 09:14:58.003928 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:14:58.279741 run patchelf(pid=19155): Launched 09:14:58.460398 run osmo-stp_10.42.42.5(pid=19152): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19152)] 09:14:58.597740 run osmo-stp_10.42.42.5(pid=19152): stdout: | (launched: 2022-12-09_09:14:57.130107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:58.737012 run osmo-stp_10.42.42.5(pid=19152): stderr: | [0;m[38;5;43m20221209091457321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091457321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091457321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091457322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091457322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091457322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091457322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:58.876324 run osmo-stp_10.42.42.5(pid=19152): stdout: | (launched: 2022-12-09_09:14:57.130107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:59.009888 run osmo-stp_10.42.42.5(pid=19152): stderr: | [0;m[38;5;43m20221209091457321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091457321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091457321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091457322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091457322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091457322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091457322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:59.168071 run patchelf(pid=19155): Terminating (SIGINT) 09:14:59.350675 run patchelf(pid=19155): Terminated: ok {rc=0} 09:14:59.481841 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19152): Process ended prematurely: osmo-stp_10.42.42.5(pid=19152) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19152)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:14:59.491996 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:14:59.521505 run osmo-hlr_10.42.42.2(pid=19149): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19149)] 09:14:59.571597 run osmo-hlr_10.42.42.2(pid=19149): stdout: | (launched: 2022-12-09_09:14:56.112104) 09:14:59.623479 run osmo-hlr_10.42.42.2(pid=19149): stderr: | [0;m[1;31m20221209091456308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091456308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091456308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091456308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091456308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091456309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091456321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091456330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091456331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091456331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:59.675793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19138): Terminating (SIGTERM) 09:14:59.717611 run iperf3-srv_10.42.42.10(pid=19139): Terminating (SIGTERM) 09:14:59.759708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19140): Terminating (SIGTERM) 09:14:59.801968 run iperf3-srv_10.42.42.10(pid=19141): Terminating (SIGTERM) 09:14:59.843689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19142): Terminating (SIGTERM) 09:14:59.885641 run iperf3-srv_10.42.42.10(pid=19143): Terminating (SIGTERM) 09:14:59.927291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19144): Terminating (SIGTERM) 09:14:59.969066 run iperf3-srv_10.42.42.10(pid=19145): Terminating (SIGTERM) 09:15:00.010815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19148): Terminating (SIGTERM) 09:15:00.052716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19151): Terminating (SIGTERM) 09:15:00.094450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19154): Terminating (SIGTERM) 09:15:00.136420 --- ParallelTerminationStrategy: PID 19138 died... 09:15:00.156380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19138): Terminated: ok {rc=0} 09:15:00.203145 --- ParallelTerminationStrategy: PID 19139 died... 09:15:00.222657 run iperf3-srv_10.42.42.10(pid=19139): Terminated {rc=256} 09:15:00.268929 --- ParallelTerminationStrategy: PID 19140 died... 09:15:00.288849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19140): Terminated: ok {rc=0} 09:15:00.335210 --- ParallelTerminationStrategy: PID 19141 died... 09:15:00.354693 run iperf3-srv_10.42.42.10(pid=19141): Terminated {rc=256} 09:15:00.400913 --- ParallelTerminationStrategy: PID 19142 died... 09:15:00.420330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19142): Terminated: ok {rc=0} 09:15:00.466595 --- ParallelTerminationStrategy: PID 19143 died... 09:15:00.486080 run iperf3-srv_10.42.42.10(pid=19143): Terminated {rc=256} 09:15:00.532332 --- ParallelTerminationStrategy: PID 19144 died... 09:15:00.551742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19144): Terminated: ok {rc=0} 09:15:00.598264 --- ParallelTerminationStrategy: PID 19145 died... 09:15:00.617766 run iperf3-srv_10.42.42.10(pid=19145): Terminated {rc=256} 09:15:00.664025 --- ParallelTerminationStrategy: PID 19148 died... 09:15:00.683518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19148): Terminated: ok {rc=0} 09:15:00.730014 --- ParallelTerminationStrategy: PID 19151 died... 09:15:00.749873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19151): Terminated: ok {rc=0} 09:15:00.796388 --- ParallelTerminationStrategy: PID 19154 died... 09:15:00.815970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19154): Terminated: ok {rc=0} 09:15:00.931303 bus /gobi_4: Setting Powered False 09:15:02.042686 bus /gobi_4: Setting Powered False 09:15:03.161325 bus /gobi_1: Setting Powered False 09:15:04.259220 bus /gobi_1: Setting Powered False 09:15:05.370321 bus /gobi_0: Setting Powered False 09:15:06.468371 bus /gobi_0: Setting Powered False 09:15:07.587377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:15:08.693266 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:08.705634 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:15:08.779376 tst ping.py: using LAC 20445 09:15:08.906581 tst ping.py: using RAC 45 09:15:09.031323 tst ping.py: using CellId 20445 09:15:09.158253 tst ping.py: using BVCI 20446 09:15:09.274763 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:09.286410 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:09.297915 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:09.309470 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:09.320760 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:09.332317 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:09.343982 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:09.355525 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:09.476200 tst ping.py:19: start network... 09:15:09.692793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:10.191775 run create_hlr_db(pid=19159): Launched 09:15:10.316557 bus /gobi_6: Setting Powered False 09:15:11.380383 run create_hlr_db(pid=19159): Terminated: ok {rc=0} 09:15:11.810878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19161): Launched 09:15:12.112664 run osmo-hlr_10.42.42.2(pid=19162): Launched 09:15:12.227405 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:12.750955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19164): Launched 09:15:13.050823 run osmo-stp_10.42.42.5(pid=19165): Launched 09:15:13.165725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:13.684830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19167): Launched 09:15:13.799629 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:14.053238 run patchelf(pid=19168): Launched 09:15:14.220160 run osmo-stp_10.42.42.5(pid=19165): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19165)] 09:15:14.347009 run osmo-stp_10.42.42.5(pid=19165): stdout: | (launched: 2022-12-09_09:15:12.994902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:14.475064 run osmo-stp_10.42.42.5(pid=19165): stderr: | [0;m[38;5;43m20221209091513161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091513162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091513162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091513162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091513163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091513163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091513163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:14.603144 run osmo-stp_10.42.42.5(pid=19165): stdout: | (launched: 2022-12-09_09:15:12.994902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:14.725635 run osmo-stp_10.42.42.5(pid=19165): stderr: | [0;m[38;5;43m20221209091513161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091513162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091513162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091513162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091513163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091513163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091513163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:14.871206 run patchelf(pid=19168): Terminating (SIGINT) 09:15:15.039202 run patchelf(pid=19168): Terminated: ok {rc=0} 09:15:15.160029 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19165): Process ended prematurely: osmo-stp_10.42.42.5(pid=19165) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19165)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 09:15:15.168879 tst ping.py:22: Test FAILED (6.5 sec) 09:15:15.195480 run osmo-hlr_10.42.42.2(pid=19162): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19162)] 09:15:15.242616 run osmo-hlr_10.42.42.2(pid=19162): stdout: | (launched: 2022-12-09_09:15:12.056911) 09:15:15.291392 run osmo-hlr_10.42.42.2(pid=19162): stderr: | [0;m[1;31m20221209091512230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091512230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091512230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091512231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091512231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091512231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091512243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091512254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091512254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091512254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:15.340573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19161): Terminating (SIGTERM) 09:15:15.380495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19164): Terminating (SIGTERM) 09:15:15.420030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19167): Terminating (SIGTERM) 09:15:15.459928 --- ParallelTerminationStrategy: PID 19161 died... 09:15:15.478837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19161): Terminated: ok {rc=0} 09:15:15.522846 --- ParallelTerminationStrategy: PID 19164 died... 09:15:15.541421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19164): Terminated: ok {rc=0} 09:15:15.584642 --- ParallelTerminationStrategy: PID 19167 died... 09:15:15.603168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19167): Terminated: ok {rc=0} 09:15:15.688015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:15:16.779114 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:16.797869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:15:16.894254 tst ping_idle_ping.py: using LAC 20446 09:15:17.021494 tst ping_idle_ping.py: using RAC 46 09:15:17.145362 tst ping_idle_ping.py: using CellId 20446 09:15:17.266910 tst ping_idle_ping.py: using BVCI 20447 09:15:17.378993 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.390082 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.401080 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.412388 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.423741 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.435044 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.446470 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:15:17.457973 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:15:17.574512 tst ping_idle_ping.py:24: start network... 09:15:17.775984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:18.247538 run create_hlr_db(pid=19169): Launched 09:15:18.372145 bus /gobi_6: Setting Powered False 09:15:19.432036 run create_hlr_db(pid=19169): Terminated: ok {rc=0} 09:15:19.876041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19171): Launched 09:15:20.198094 run osmo-hlr_10.42.42.2(pid=19172): Launched 09:15:20.316279 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:20.837181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19174): Launched 09:15:21.160520 run osmo-stp_10.42.42.5(pid=19175): Launched 09:15:21.285225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:21.842880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19177): Launched 09:15:21.967485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:22.239531 run patchelf(pid=19178): Launched 09:15:22.419436 run osmo-stp_10.42.42.5(pid=19175): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19175)] 09:15:22.555579 run osmo-stp_10.42.42.5(pid=19175): stdout: | (launched: 2022-12-09_09:15:21.101357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:22.693396 run osmo-stp_10.42.42.5(pid=19175): stderr: | [0;m[38;5;43m20221209091521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091521293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:22.831470 run osmo-stp_10.42.42.5(pid=19175): stdout: | (launched: 2022-12-09_09:15:21.101357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:22.963344 run osmo-stp_10.42.42.5(pid=19175): stderr: | [0;m[38;5;43m20221209091521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091521293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:23.119462 run patchelf(pid=19178): Terminating (SIGINT) 09:15:23.298911 run patchelf(pid=19178): Terminated: ok {rc=0} 09:15:23.428048 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19175): Process ended prematurely: osmo-stp_10.42.42.5(pid=19175) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19175)] [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:15:23.437715 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:15:23.466305 run osmo-hlr_10.42.42.2(pid=19172): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19172)] 09:15:23.517132 run osmo-hlr_10.42.42.2(pid=19172): stdout: | (launched: 2022-12-09_09:15:20.139034) 09:15:23.569852 run osmo-hlr_10.42.42.2(pid=19172): stderr: | [0;m[1;31m20221209091520319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091520319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091520319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091520319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091520319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091520319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091520331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:23.622664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19171): Terminating (SIGTERM) 09:15:23.665264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19174): Terminating (SIGTERM) 09:15:23.707467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19177): Terminating (SIGTERM) 09:15:23.750762 --- ParallelTerminationStrategy: PID 19171 died... 09:15:23.770804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19171): Terminated: ok {rc=0} 09:15:23.818486 --- ParallelTerminationStrategy: PID 19174 died... 09:15:23.838397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19174): Terminated: ok {rc=0} 09:15:23.885462 --- ParallelTerminationStrategy: PID 19177 died... 09:15:23.905357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19177): Terminated: ok {rc=0} 09:15:23.994727 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:15:25.331447 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:25.339491 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:15:25.373350 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:15:25.409043 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:15:25.462883 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:15:25.496088 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:15:25.530987 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:15:26.090717 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:15:26.098318 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.110843 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:15:26.185089 tst switch_tch_pdch.py: using LAC 20447 09:15:26.310761 tst switch_tch_pdch.py: using RAC 47 09:15:26.437076 tst switch_tch_pdch.py: using CellId 20447 09:15:26.561589 tst switch_tch_pdch.py: using BVCI 20448 09:15:26.672686 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.684155 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.695395 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.707115 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.718815 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.730469 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.742426 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:15:26.754179 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:15:26.875825 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:15:27.002438 tst switch_tch_pdch.py:51: start network... 09:15:27.220549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:27.719030 run create_hlr_db(pid=19185): Launched 09:15:27.843284 bus /gobi_6: Setting Powered False 09:15:28.906380 run create_hlr_db(pid=19185): Terminated: ok {rc=0} 09:15:29.334354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19187): Launched 09:15:29.636338 run osmo-hlr_10.42.42.2(pid=19188): Launched 09:15:29.751325 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:30.266005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19190): Launched 09:15:30.565460 run osmo-stp_10.42.42.5(pid=19191): Launched 09:15:30.679000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:31.224290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19193): Launched 09:15:31.397673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:31.664450 run patchelf(pid=19194): Launched 09:15:31.848474 run osmo-stp_10.42.42.5(pid=19191): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19191)] 09:15:31.978164 run osmo-stp_10.42.42.5(pid=19191): stdout: | (launched: 2022-12-09_09:15:30.509646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:32.108774 run osmo-stp_10.42.42.5(pid=19191): stderr: | [0;m[38;5;43m20221209091530679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091530680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091530680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091530680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091530681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091530681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091530681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:32.239064 run osmo-stp_10.42.42.5(pid=19191): stdout: | (launched: 2022-12-09_09:15:30.509646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:32.362466 run osmo-stp_10.42.42.5(pid=19191): stderr: | [0;m[38;5;43m20221209091530679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091530680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091530680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091530680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091530681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091530681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091530681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:32.507684 run patchelf(pid=19194): Terminating (SIGINT) 09:15:32.675479 run patchelf(pid=19194): Terminated: ok {rc=0} 09:15:32.796255 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19191): Process ended prematurely: osmo-stp_10.42.42.5(pid=19191) [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19191)] [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:15:32.805617 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:15:32.832419 run osmo-hlr_10.42.42.2(pid=19188): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19188)] 09:15:32.879867 run osmo-hlr_10.42.42.2(pid=19188): stdout: | (launched: 2022-12-09_09:15:29.580333) 09:15:32.929245 run osmo-hlr_10.42.42.2(pid=19188): stderr: | [0;m[1;31m20221209091529756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091529756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091529756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091529756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091529756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091529756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091529790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091529801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091529802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091529802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:32.978678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19187): Terminating (SIGTERM) 09:15:33.018344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19190): Terminating (SIGTERM) 09:15:33.058032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19193): Terminating (SIGTERM) 09:15:33.097985 --- ParallelTerminationStrategy: PID 19187 died... 09:15:33.117101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19187): Terminated: ok {rc=0} 09:15:33.161201 --- ParallelTerminationStrategy: PID 19190 died... 09:15:33.179893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19190): Terminated: ok {rc=0} 09:15:33.223699 --- ParallelTerminationStrategy: PID 19193 died... 09:15:33.242282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19193): Terminated: ok {rc=0} 09:15:33.327849 bus /gobi_0: Setting Powered False 09:15:34.426606 bus /gobi_0: Setting Powered False 09:15:35.542185 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:15:36.802685 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:36.808769 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:15:36.844621 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:15:36.881052 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:15:36.936236 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:15:36.971293 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:15:37.007757 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:15:37.565538 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:15:37.570798 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:37.582525 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:15:37.654402 tst switch_tch_pdch.py: using LAC 20448 09:15:37.781450 tst switch_tch_pdch.py: using RAC 48 09:15:37.909393 tst switch_tch_pdch.py: using CellId 20448 09:15:38.034378 tst switch_tch_pdch.py: using BVCI 20449 09:15:38.150835 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:38.162542 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:38.173867 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:38.185508 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:38.196819 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:38.208355 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:38.219963 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:15:38.231593 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:15:38.349189 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:15:38.465774 tst switch_tch_pdch.py:51: start network... 09:15:38.666397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:39.105220 run create_hlr_db(pid=19198): Launched 09:15:39.228696 bus /gobi_6: Setting Powered False 09:15:40.289073 run create_hlr_db(pid=19198): Terminated: ok {rc=0} 09:15:40.699311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19200): Launched 09:15:41.023442 run osmo-hlr_10.42.42.2(pid=19201): Launched 09:15:41.145962 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:41.672126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19203): Launched 09:15:41.994343 run osmo-stp_10.42.42.5(pid=19204): Launched 09:15:42.118076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:15:42.643483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19206): Launched 09:15:42.767929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:15:43.039758 run patchelf(pid=19207): Launched 09:15:43.219242 run osmo-stp_10.42.42.5(pid=19204): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19204)] 09:15:43.355289 run osmo-stp_10.42.42.5(pid=19204): stdout: | (launched: 2022-12-09_09:15:41.935347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:43.492633 run osmo-stp_10.42.42.5(pid=19204): stderr: | [0;m[38;5;43m20221209091542126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091542126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091542126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091542126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091542127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091542127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091542127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:43.630438 run osmo-stp_10.42.42.5(pid=19204): stdout: | (launched: 2022-12-09_09:15:41.935347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:43.762987 run osmo-stp_10.42.42.5(pid=19204): stderr: | [0;m[38;5;43m20221209091542126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091542126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091542126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091542126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091542127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091542127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091542127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:43.919251 run patchelf(pid=19207): Terminating (SIGINT) 09:15:44.099554 run patchelf(pid=19207): Terminated: ok {rc=0} 09:15:44.229308 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19204): Process ended prematurely: osmo-stp_10.42.42.5(pid=19204) [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19204)] [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:15:44.238908 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:15:44.267268 run osmo-hlr_10.42.42.2(pid=19201): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19201)] 09:15:44.317531 run osmo-hlr_10.42.42.2(pid=19201): stdout: | (launched: 2022-12-09_09:15:40.963986) 09:15:44.369695 run osmo-hlr_10.42.42.2(pid=19201): stderr: | [0;m[1;31m20221209091541161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091541161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091541161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091541161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091541161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091541161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091541174 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091541182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091541182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091541182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:44.422364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19200): Terminating (SIGTERM) 09:15:44.464333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19203): Terminating (SIGTERM) 09:15:44.506416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19206): Terminating (SIGTERM) 09:15:44.548815 --- ParallelTerminationStrategy: PID 19200 died... 09:15:44.568914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19200): Terminated: ok {rc=0} 09:15:44.615867 --- ParallelTerminationStrategy: PID 19203 died... 09:15:44.635523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19203): Terminated: ok {rc=0} 09:15:44.682449 --- ParallelTerminationStrategy: PID 19206 died... 09:15:44.702345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19206): Terminated: ok {rc=0} 09:15:44.790343 bus /gobi_0: Setting Powered False 09:15:45.896206 bus /gobi_0: Setting Powered False 09:15:47.023988 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:15:48.288239 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:48.292468 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:15:48.323218 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:15:48.330364 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:15:48.384863 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:15:48.415581 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:15:48.422678 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:15:48.965814 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:15:48.971389 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:15:48.984718 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:15:49.030377 tst mo_mt_sms.py: using LAC 20449 09:15:49.155311 tst mo_mt_sms.py: using RAC 49 09:15:49.292194 tst mo_mt_sms.py: using CellId 20449 09:15:49.420610 tst mo_mt_sms.py: using BVCI 20450 09:15:49.537890 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:15:49.655368 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:15:49.773869 tst mo_mt_sms.py:9: start nitb and bts... 09:15:49.992035 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:15:50.643970 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19212): Launched 09:15:50.965635 run osmo-nitb_10.42.42.2(pid=19213): Launched 09:15:51.144439 run osmo-nitb_10.42.42.2(pid=19213): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19213)] 09:15:51.287572 run osmo-nitb_10.42.42.2(pid=19213): stdout: | (launched: 2022-12-09_09:15:50.906836) 09:15:51.432205 run osmo-nitb_10.42.42.2(pid=19213): stderr: | (launched: 2022-12-09_09:15:50.954721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:15:51.576686 run osmo-nitb_10.42.42.2(pid=19213): stdout: | (launched: 2022-12-09_09:15:50.906836) 09:15:51.715500 run osmo-nitb_10.42.42.2(pid=19213): stderr: | (launched: 2022-12-09_09:15:50.954721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19213): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19213) [trial-2357↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19213)] 09:15:52.087928 tst osmo-nitb_10.42.42.2(pid=19213): stdout: | (launched: 2022-12-09_09:15:50.906836) 09:15:52.216846 tst osmo-nitb_10.42.42.2(pid=19213): stderr: | (launched: 2022-12-09_09:15:50.954721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:15:52.369561 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19213): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19213) [trial-2357↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19213)] [trial-2357↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 09:15:52.378777 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:15:52.386028 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19212): Terminating (SIGTERM) 09:15:52.596627 --- ParallelTerminationStrategy: PID 19212 died... 09:15:52.618005 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19212): Terminated: ok {rc=0} 09:15:52.706496 bus /sierra_3: Setting Powered False 09:15:53.806376 bus /sierra_3: Setting Powered False 09:15:54.927695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:15:56.121972 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:56.125771 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:15:56.155091 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:15:56.182096 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:15:56.235493 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:15:56.265342 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:15:56.292410 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:15:56.841135 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:15:56.846045 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:15:56.857068 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:15:56.900813 tst mo_mt_sms.py: using LAC 20450 09:15:57.020493 tst mo_mt_sms.py: using RAC 50 09:15:57.139861 tst mo_mt_sms.py: using CellId 20450 09:15:57.257027 tst mo_mt_sms.py: using BVCI 20451 09:15:57.374745 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:15:57.386297 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:15:57.397853 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:15:57.409759 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:15:57.421427 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:15:57.433552 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:15:57.552939 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:15:57.673142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:58.174849 run create_hlr_db(pid=19217): Launched 09:15:58.299358 bus /sierra_2: Setting Powered False 09:15:59.363627 run create_hlr_db(pid=19217): Terminated: ok {rc=0} 09:15:59.793280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19219): Launched 09:16:00.094599 run osmo-hlr_10.42.42.2(pid=19220): Launched 09:16:00.209563 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:00.726922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19222): Launched 09:16:01.074157 run osmo-stp_10.42.42.5(pid=19223): Launched 09:16:01.411952 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:02.058708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19225): Launched 09:16:02.398821 run osmo-msc_10.42.42.6(pid=19226): Launched 09:16:02.583331 run osmo-stp_10.42.42.5(pid=19223): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19223)] 09:16:02.721641 run osmo-stp_10.42.42.5(pid=19223): stdout: | (launched: 2022-12-09_09:16:01.013406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:02.860750 run osmo-stp_10.42.42.5(pid=19223): stderr: | [0;m[38;5;43m20221209091601237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091601237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091601237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091601237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091601238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091601238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091601238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:02.995915 run osmo-stp_10.42.42.5(pid=19223): stdout: | (launched: 2022-12-09_09:16:01.013406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:03.124477 run osmo-stp_10.42.42.5(pid=19223): stderr: | [0;m[38;5;43m20221209091601237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091601237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091601237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091601237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091601238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091601238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091601238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:03.278064 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19223): Process ended prematurely: osmo-stp_10.42.42.5(pid=19223) [trial-2357↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19223)] [trial-2357↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 09:16:03.287080 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 09:16:03.315581 run osmo-hlr_10.42.42.2(pid=19220): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19220)] 09:16:03.366381 run osmo-hlr_10.42.42.2(pid=19220): stdout: | (launched: 2022-12-09_09:16:00.039104) 09:16:03.419281 run osmo-hlr_10.42.42.2(pid=19220): stderr: | [0;m[1;31m20221209091600214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091600214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091600214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091600214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091600214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091600214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091600226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091600237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091600237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091600237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:03.492606 run osmo-msc_10.42.42.6(pid=19226): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19226)] 09:16:03.543918 run osmo-msc_10.42.42.6(pid=19226): stdout: | (launched: 2022-12-09_09:16:02.339096) 09:16:03.597420 run osmo-msc_10.42.42.6(pid=19226): stderr: | [0;m[38;5;43m20221209091602656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091602657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc17b1c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091602657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091602657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091602657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091602657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091602659 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091602659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091602659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091602660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:03.650502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19219): Terminating (SIGTERM) 09:16:03.693300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19222): Terminating (SIGTERM) 09:16:03.735977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19225): Terminating (SIGTERM) 09:16:03.779341 --- ParallelTerminationStrategy: PID 19219 died... 09:16:03.799328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19219): Terminated: ok {rc=0} 09:16:03.846853 --- ParallelTerminationStrategy: PID 19222 died... 09:16:03.866694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19222): Terminated: ok {rc=0} 09:16:03.913765 --- ParallelTerminationStrategy: PID 19225 died... 09:16:03.933556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19225): Terminated: ok {rc=0} 09:16:04.022896 bus /sierra_3: Setting Powered False 09:16:05.122983 bus /sierra_3: Setting Powered False 09:16:06.241435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:16:07.479955 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:07.484799 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:16:07.518269 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:16:07.525151 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:16:07.559392 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:16:07.589178 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:16:07.595891 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:16:08.118097 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:16:08.122969 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:16:08.134159 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:16:08.180067 tst assert_extension.py: using LAC 20451 09:16:08.297081 tst assert_extension.py: using RAC 51 09:16:08.413866 tst assert_extension.py: using CellId 20451 09:16:08.531489 tst assert_extension.py: using BVCI 20452 09:16:08.641228 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:16:08.758785 tst assert_extension.py:10: start nitb and bts... 09:16:08.975277 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:16:09.631473 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19231): Launched 09:16:09.953295 run osmo-nitb_10.42.42.2(pid=19232): Launched 09:16:10.132619 run osmo-nitb_10.42.42.2(pid=19232): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19232)] 09:16:10.276129 run osmo-nitb_10.42.42.2(pid=19232): stdout: | (launched: 2022-12-09_09:16:09.894147) 09:16:10.421370 run osmo-nitb_10.42.42.2(pid=19232): stderr: | (launched: 2022-12-09_09:16:09.942210) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:16:10.566684 run osmo-nitb_10.42.42.2(pid=19232): stdout: | (launched: 2022-12-09_09:16:09.894147) 09:16:10.706371 run osmo-nitb_10.42.42.2(pid=19232): stderr: | (launched: 2022-12-09_09:16:09.942210) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19232): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19232) [trial-2357↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19232)] 09:16:11.076089 tst osmo-nitb_10.42.42.2(pid=19232): stdout: | (launched: 2022-12-09_09:16:09.894147) 09:16:11.205463 tst osmo-nitb_10.42.42.2(pid=19232): stderr: | (launched: 2022-12-09_09:16:09.942210) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:16:11.358396 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19232): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19232) [trial-2357↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19232)] [trial-2357↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 09:16:11.367533 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:16:11.374853 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19231): Terminating (SIGTERM) 09:16:11.586605 --- ParallelTerminationStrategy: PID 19231 died... 09:16:11.608742 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19231): Terminated: ok {rc=0} 09:16:11.699135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:16:12.872543 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:12.876250 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:16:12.906247 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:16:12.933070 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:16:12.968527 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:16:12.997999 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:16:13.025226 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:16:13.556240 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:16:13.561211 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:13.572015 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:16:13.615796 tst assert_extension.py: using LAC 20452 09:16:13.732677 tst assert_extension.py: using RAC 52 09:16:13.849360 tst assert_extension.py: using CellId 20452 09:16:13.966854 tst assert_extension.py: using BVCI 20453 09:16:14.075307 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:14.086357 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:14.097252 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:14.108016 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:14.119169 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:14.129890 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:16:14.249225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:14.713749 run create_hlr_db(pid=19237): Launched 09:16:14.836625 bus /sierra_2: Setting Powered False 09:16:15.910847 run create_hlr_db(pid=19237): Terminated: ok {rc=0} 09:16:16.377247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19239): Launched 09:16:16.719467 run osmo-hlr_10.42.42.2(pid=19240): Launched 09:16:16.967930 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:17.567254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19242): Launched 09:16:17.868318 run osmo-stp_10.42.42.5(pid=19243): Launched 09:16:17.983165 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:18.525971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19245): Launched 09:16:18.827437 run osmo-msc_10.42.42.6(pid=19246): Launched 09:16:18.996442 run osmo-stp_10.42.42.5(pid=19243): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19243)] 09:16:19.123836 run osmo-stp_10.42.42.5(pid=19243): stdout: | (launched: 2022-12-09_09:16:17.812490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:19.250595 run osmo-stp_10.42.42.5(pid=19243): stderr: | [0;m[38;5;43m20221209091617982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091617982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091617983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091617983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091617984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091617984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091617984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:19.375553 run osmo-stp_10.42.42.5(pid=19243): stdout: | (launched: 2022-12-09_09:16:17.812490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:19.494731 run osmo-stp_10.42.42.5(pid=19243): stderr: | [0;m[38;5;43m20221209091617982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091617982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091617983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091617983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091617984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091617984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091617984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:19.637735 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19243): Process ended prematurely: osmo-stp_10.42.42.5(pid=19243) [trial-2357↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19243)] [trial-2357↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 09:16:19.645802 tst assert_extension.py:17: Test FAILED (6.1 sec) 09:16:19.671848 run osmo-hlr_10.42.42.2(pid=19240): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19240)] 09:16:19.719473 run osmo-hlr_10.42.42.2(pid=19240): stdout: | (launched: 2022-12-09_09:16:16.659599) 09:16:19.768616 run osmo-hlr_10.42.42.2(pid=19240): stderr: | [0;m[1;31m20221209091616970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091616970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091616970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091616970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091616970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091616970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091616987 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091617011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091617011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091617011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:19.837755 run osmo-msc_10.42.42.6(pid=19246): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19246)] 09:16:19.885446 run osmo-msc_10.42.42.6(pid=19246): stdout: | (launched: 2022-12-09_09:16:18.771373) 09:16:19.934807 run osmo-msc_10.42.42.6(pid=19246): stderr: | [0;m[38;5;43m20221209091619041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091619041 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f79284dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091619041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091619041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091619042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091619042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091619043 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091619044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091619044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091619044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:19.984885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19239): Terminating (SIGTERM) 09:16:20.024931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19242): Terminating (SIGTERM) 09:16:20.064888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19245): Terminating (SIGTERM) 09:16:20.105112 --- ParallelTerminationStrategy: PID 19239 died... 09:16:20.124288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19239): Terminated: ok {rc=0} 09:16:20.168355 --- ParallelTerminationStrategy: PID 19242 died... 09:16:20.187068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19242): Terminated: ok {rc=0} 09:16:20.230819 --- ParallelTerminationStrategy: PID 19245 died... 09:16:20.249485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19245): Terminated: ok {rc=0} 09:16:20.333897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:16:21.544294 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:21.550634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:16:21.579952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:16:21.606836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:16:21.659645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:16:21.689178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:16:21.716086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:16:22.275275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:16:22.326331 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:22.337843 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:16:22.405513 tst mo_mt_call.py: using LAC 20453 09:16:22.535202 tst mo_mt_call.py: using RAC 53 09:16:22.663758 tst mo_mt_call.py: using CellId 20453 09:16:22.793477 tst mo_mt_call.py: using BVCI 20454 09:16:22.914883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:22.927137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:22.939254 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:22.951369 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:22.963655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:22.975841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:16:23.096220 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:16:23.215026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:23.690630 run create_hlr_db(pid=19251): Launched 09:16:23.815656 bus /sierra_2: Setting Powered False 09:16:24.877049 run create_hlr_db(pid=19251): Terminated: ok {rc=0} 09:16:25.322323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19253): Launched 09:16:25.650579 run osmo-hlr_10.42.42.2(pid=19254): Launched 09:16:25.779432 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:26.345782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19256): Launched 09:16:26.673582 run osmo-stp_10.42.42.5(pid=19257): Launched 09:16:26.800347 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:27.390415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19259): Launched 09:16:27.718225 run osmo-msc_10.42.42.6(pid=19260): Launched 09:16:27.903284 run osmo-stp_10.42.42.5(pid=19257): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19257)] 09:16:28.040702 run osmo-stp_10.42.42.5(pid=19257): stdout: | (launched: 2022-12-09_09:16:26.613748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:28.179407 run osmo-stp_10.42.42.5(pid=19257): stderr: | [0;m[38;5;43m20221209091626804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091626805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091626806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091626806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091626806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091626807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091626807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:28.315359 run osmo-stp_10.42.42.5(pid=19257): stdout: | (launched: 2022-12-09_09:16:26.613748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:28.446325 run osmo-stp_10.42.42.5(pid=19257): stderr: | [0;m[38;5;43m20221209091626804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091626805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091626806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091626806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091626806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091626807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091626807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:28.602114 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19257): Process ended prematurely: osmo-stp_10.42.42.5(pid=19257) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19257)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:16:28.611577 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:16:28.640061 run osmo-hlr_10.42.42.2(pid=19254): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19254)] 09:16:28.690430 run osmo-hlr_10.42.42.2(pid=19254): stdout: | (launched: 2022-12-09_09:16:25.590694) 09:16:28.742594 run osmo-hlr_10.42.42.2(pid=19254): stderr: | [0;m[1;31m20221209091625788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091625788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091625788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091625788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091625788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091625788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091625801 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091625811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091625812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091625812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:28.815366 run osmo-msc_10.42.42.6(pid=19260): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19260)] 09:16:28.865612 run osmo-msc_10.42.42.6(pid=19260): stdout: | (launched: 2022-12-09_09:16:27.658422) 09:16:28.917572 run osmo-msc_10.42.42.6(pid=19260): stderr: | [0;m[38;5;43m20221209091627978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091627978 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f63351c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091627978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091627978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091627979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091627979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091627980 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091627981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091627981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091627981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:28.969885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19253): Terminating (SIGTERM) 09:16:29.011563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19256): Terminating (SIGTERM) 09:16:29.053600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19259): Terminating (SIGTERM) 09:16:29.095813 --- ParallelTerminationStrategy: PID 19253 died... 09:16:29.115877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19253): Terminated: ok {rc=0} 09:16:29.162466 --- ParallelTerminationStrategy: PID 19256 died... 09:16:29.182043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19256): Terminated: ok {rc=0} 09:16:29.228368 --- ParallelTerminationStrategy: PID 19259 died... 09:16:29.247905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19259): Terminated: ok {rc=0} 09:16:29.335488 bus /sierra_3: Setting Powered False 09:16:30.433268 bus /sierra_3: Setting Powered False 09:16:31.560903 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:16:32.723395 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:32.736057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:16:32.806520 tst mo_mt_call_osmux.py: using LAC 20454 09:16:32.935137 tst mo_mt_call_osmux.py: using RAC 54 09:16:33.065350 tst mo_mt_call_osmux.py: using CellId 20454 09:16:33.193244 tst mo_mt_call_osmux.py: using BVCI 20455 09:16:33.313442 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:33.325593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:33.337534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:33.349719 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:33.361943 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:16:33.374028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:16:33.491372 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:16:33.614740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:34.090889 run create_hlr_db(pid=19262): Launched 09:16:34.216120 bus /sierra_2: Setting Powered False 09:16:35.276437 run create_hlr_db(pid=19262): Terminated: ok {rc=0} 09:16:35.721535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19264): Launched 09:16:36.049286 run osmo-hlr_10.42.42.2(pid=19265): Launched 09:16:36.175154 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:36.739804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19267): Launched 09:16:37.069151 run osmo-stp_10.42.42.5(pid=19268): Launched 09:16:37.193647 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:37.791636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19270): Launched 09:16:38.122781 run osmo-msc_10.42.42.6(pid=19271): Launched 09:16:38.308910 run osmo-stp_10.42.42.5(pid=19268): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19268)] 09:16:38.448041 run osmo-stp_10.42.42.5(pid=19268): stdout: | (launched: 2022-12-09_09:16:37.009030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:38.587395 run osmo-stp_10.42.42.5(pid=19268): stderr: | [0;m[38;5;43m20221209091637201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091637201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091637202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091637202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091637203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091637203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091637203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:38.724793 run osmo-stp_10.42.42.5(pid=19268): stdout: | (launched: 2022-12-09_09:16:37.009030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:38.856698 run osmo-stp_10.42.42.5(pid=19268): stderr: | [0;m[38;5;43m20221209091637201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091637201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091637202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091637202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091637203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091637203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091637203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:39.014167 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19268): Process ended prematurely: osmo-stp_10.42.42.5(pid=19268) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19268)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:16:39.023639 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:16:39.052201 run osmo-hlr_10.42.42.2(pid=19265): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19265)] 09:16:39.103115 run osmo-hlr_10.42.42.2(pid=19265): stdout: | (launched: 2022-12-09_09:16:35.988555) 09:16:39.155542 run osmo-hlr_10.42.42.2(pid=19265): stderr: | [0;m[1;31m20221209091636187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091636187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091636187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091636187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091636187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091636187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091636201 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091636211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091636211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091636211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:39.228762 run osmo-msc_10.42.42.6(pid=19271): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19271)] 09:16:39.279336 run osmo-msc_10.42.42.6(pid=19271): stdout: | (launched: 2022-12-09_09:16:38.061978) 09:16:39.331673 run osmo-msc_10.42.42.6(pid=19271): stderr: | [0;m[38;5;43m20221209091638384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091638384 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c13ce1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091638384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091638385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091638385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091638385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091638387 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091638387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091638387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091638387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:39.384523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19264): Terminating (SIGTERM) 09:16:39.426977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19267): Terminating (SIGTERM) 09:16:39.469325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19270): Terminating (SIGTERM) 09:16:39.512221 --- ParallelTerminationStrategy: PID 19264 died... 09:16:39.532443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19264): Terminated: ok {rc=0} 09:16:39.579491 --- ParallelTerminationStrategy: PID 19267 died... 09:16:39.599236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19267): Terminated: ok {rc=0} 09:16:39.646028 --- ParallelTerminationStrategy: PID 19270 died... 09:16:39.665793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19270): Terminated: ok {rc=0} 09:16:39.754217 bus /sierra_3: Setting Powered False 09:16:40.853237 bus /sierra_3: Setting Powered False 09:16:41.968543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:16:43.216463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:43.223131 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:16:43.252515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:16:43.279769 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:16:43.335034 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:16:43.367068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:16:43.394922 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:16:43.943363 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:16:43.992155 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:44.003676 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:16:44.069885 tst mo_mt_call.py: using LAC 20455 09:16:44.189324 tst mo_mt_call.py: using RAC 55 09:16:44.308748 tst mo_mt_call.py: using CellId 20455 09:16:44.438256 tst mo_mt_call.py: using BVCI 20456 09:16:44.558429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:44.570376 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:44.582073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:44.594100 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:44.606160 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:44.618040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:16:44.740258 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:16:44.857651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:45.332512 run create_hlr_db(pid=19276): Launched 09:16:45.458424 bus /sierra_2: Setting Powered False 09:16:46.523159 run create_hlr_db(pid=19276): Terminated: ok {rc=0} 09:16:46.984116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19278): Launched 09:16:47.330556 run osmo-hlr_10.42.42.2(pid=19279): Launched 09:16:47.462067 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:48.032816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19281): Launched 09:16:48.362286 run osmo-stp_10.42.42.5(pid=19282): Launched 09:16:48.489138 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:49.083536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19284): Launched 09:16:49.413705 run osmo-msc_10.42.42.6(pid=19285): Launched 09:16:49.598253 run osmo-stp_10.42.42.5(pid=19282): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19282)] 09:16:49.736018 run osmo-stp_10.42.42.5(pid=19282): stdout: | (launched: 2022-12-09_09:16:48.302024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:49.874987 run osmo-stp_10.42.42.5(pid=19282): stderr: | [0;m[38;5;43m20221209091648496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091648496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091648497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091648497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091648498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091648498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091648498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:50.012032 run osmo-stp_10.42.42.5(pid=19282): stdout: | (launched: 2022-12-09_09:16:48.302024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:50.142802 run osmo-stp_10.42.42.5(pid=19282): stderr: | [0;m[38;5;43m20221209091648496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091648496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091648497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091648497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091648498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091648498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091648498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:50.299653 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19282): Process ended prematurely: osmo-stp_10.42.42.5(pid=19282) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19282)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:16:50.309152 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:16:50.337517 run osmo-hlr_10.42.42.2(pid=19279): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19279)] 09:16:50.387646 run osmo-hlr_10.42.42.2(pid=19279): stdout: | (launched: 2022-12-09_09:16:47.270263) 09:16:50.439540 run osmo-hlr_10.42.42.2(pid=19279): stderr: | [0;m[1;31m20221209091647467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091647467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091647467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091647467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091647467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091647467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091647479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091647488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091647489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091647489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:50.512024 run osmo-msc_10.42.42.6(pid=19285): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19285)] 09:16:50.562631 run osmo-msc_10.42.42.6(pid=19285): stdout: | (launched: 2022-12-09_09:16:49.353598) 09:16:50.614378 run osmo-msc_10.42.42.6(pid=19285): stderr: | [0;m[38;5;43m20221209091649675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091649675 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb18931cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091649675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091649675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091649676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091649676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091649677 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091649678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091649678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091649678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:50.666576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19278): Terminating (SIGTERM) 09:16:50.708460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19281): Terminating (SIGTERM) 09:16:50.750463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19284): Terminating (SIGTERM) 09:16:50.793101 --- ParallelTerminationStrategy: PID 19278 died... 09:16:50.813178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19278): Terminated: ok {rc=0} 09:16:50.859877 --- ParallelTerminationStrategy: PID 19281 died... 09:16:50.879339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19281): Terminated: ok {rc=0} 09:16:50.925697 --- ParallelTerminationStrategy: PID 19284 died... 09:16:50.945277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19284): Terminated: ok {rc=0} 09:16:51.032937 bus /sierra_3: Setting Powered False 09:16:52.131687 bus /sierra_3: Setting Powered False 09:16:53.243635 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:16:54.392772 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:54.405672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:16:54.479607 tst mo_mt_call_osmux.py: using LAC 20456 09:16:54.608069 tst mo_mt_call_osmux.py: using RAC 56 09:16:54.734425 tst mo_mt_call_osmux.py: using CellId 20456 09:16:54.862530 tst mo_mt_call_osmux.py: using BVCI 20457 09:16:54.983305 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:54.995306 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:55.007133 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:55.019469 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:55.031902 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:16:55.045221 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:16:55.163348 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:16:55.286119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:55.794057 run create_hlr_db(pid=19287): Launched 09:16:55.919736 bus /sierra_2: Setting Powered False 09:16:56.983912 run create_hlr_db(pid=19287): Terminated: ok {rc=0} 09:16:57.420507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19289): Launched 09:16:57.727150 run osmo-hlr_10.42.42.2(pid=19290): Launched 09:16:57.846896 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:58.386924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19292): Launched 09:16:58.692907 run osmo-stp_10.42.42.5(pid=19293): Launched 09:16:58.810065 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:59.365165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19295): Launched 09:16:59.671034 run osmo-msc_10.42.42.6(pid=19296): Launched 09:16:59.844695 run osmo-stp_10.42.42.5(pid=19293): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19293)] 09:16:59.973946 run osmo-stp_10.42.42.5(pid=19293): stdout: | (launched: 2022-12-09_09:16:58.636218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:00.103326 run osmo-stp_10.42.42.5(pid=19293): stderr: | [0;m[38;5;43m20221209091658808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091658808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091658808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091658809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091658809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091658809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091658810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:00.230631 run osmo-stp_10.42.42.5(pid=19293): stdout: | (launched: 2022-12-09_09:16:58.636218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:00.353208 run osmo-stp_10.42.42.5(pid=19293): stderr: | [0;m[38;5;43m20221209091658808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091658808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091658808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091658809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091658809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091658809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091658810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:00.499336 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19293): Process ended prematurely: osmo-stp_10.42.42.5(pid=19293) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19293)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:17:00.508227 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:17:00.534959 run osmo-hlr_10.42.42.2(pid=19290): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19290)] 09:17:00.582702 run osmo-hlr_10.42.42.2(pid=19290): stdout: | (launched: 2022-12-09_09:16:57.670774) 09:17:00.632086 run osmo-hlr_10.42.42.2(pid=19290): stderr: | [0;m[1;31m20221209091657850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091657850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091657850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091657850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091657850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091657850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091657862 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091657872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091657873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091657873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:00.701143 run osmo-msc_10.42.42.6(pid=19296): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19296)] 09:17:00.748696 run osmo-msc_10.42.42.6(pid=19296): stdout: | (launched: 2022-12-09_09:16:59.614514) 09:17:00.797831 run osmo-msc_10.42.42.6(pid=19296): stderr: | [0;m[38;5;43m20221209091659885 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091659885 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2896fefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091659885 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091659885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091659885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091659885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091659887 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091659888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091659888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091659888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:00.867107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19289): Terminating (SIGTERM) 09:17:00.921014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19292): Terminating (SIGTERM) 09:17:00.967009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19295): Terminating (SIGTERM) 09:17:01.014779 --- ParallelTerminationStrategy: PID 19289 died... 09:17:01.035570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19289): Terminated: ok {rc=0} 09:17:01.086831 --- ParallelTerminationStrategy: PID 19292 died... 09:17:01.107846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19292): Terminated: ok {rc=0} 09:17:01.158071 --- ParallelTerminationStrategy: PID 19295 died... 09:17:01.178748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19295): Terminated: ok {rc=0} 09:17:01.271423 bus /sierra_3: Setting Powered False 09:17:02.380125 bus /sierra_3: Setting Powered False 09:17:03.499027 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:17:04.748123 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:04.754790 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:17:04.784205 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:17:04.811213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:17:04.861565 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:17:04.890932 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:17:04.917868 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:17:05.473737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:17:05.522557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:05.534232 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:17:05.599359 tst mo_mt_call.py: using LAC 20457 09:17:05.720878 tst mo_mt_call.py: using RAC 57 09:17:05.841005 tst mo_mt_call.py: using CellId 20457 09:17:05.959647 tst mo_mt_call.py: using BVCI 20458 09:17:06.070435 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:06.082012 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:06.093436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:06.104691 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:06.116045 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:06.127308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:17:06.250762 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:17:06.373965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:06.885306 run create_hlr_db(pid=19304): Launched 09:17:07.010985 bus /sierra_2: Setting Powered False 09:17:08.076333 run create_hlr_db(pid=19304): Terminated: ok {rc=0} 09:17:08.516734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19306): Launched 09:17:08.827107 run osmo-hlr_10.42.42.2(pid=19307): Launched 09:17:08.944665 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:09.474143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19309): Launched 09:17:09.781571 run osmo-stp_10.42.42.5(pid=19310): Launched 09:17:09.898988 run osmo-msc_10.42.42.6: Starting osmo-msc 09:17:10.457463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19312): Launched 09:17:10.765138 run osmo-msc_10.42.42.6(pid=19313): Launched 09:17:10.939097 run osmo-stp_10.42.42.5(pid=19310): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19310)] 09:17:11.069216 run osmo-stp_10.42.42.5(pid=19310): stdout: | (launched: 2022-12-09_09:17:09.724761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:11.199226 run osmo-stp_10.42.42.5(pid=19310): stderr: | [0;m[38;5;43m20221209091709896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091709896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091709896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091709897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091709897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091709897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091709897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:11.326477 run osmo-stp_10.42.42.5(pid=19310): stdout: | (launched: 2022-12-09_09:17:09.724761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:11.448691 run osmo-stp_10.42.42.5(pid=19310): stderr: | [0;m[38;5;43m20221209091709896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091709896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091709896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091709897 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091709897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091709897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091709897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:11.595120 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19310): Process ended prematurely: osmo-stp_10.42.42.5(pid=19310) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19310)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:17:11.603907 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:17:11.630305 run osmo-hlr_10.42.42.2(pid=19307): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19307)] 09:17:11.677544 run osmo-hlr_10.42.42.2(pid=19307): stdout: | (launched: 2022-12-09_09:17:08.769546) 09:17:11.726513 run osmo-hlr_10.42.42.2(pid=19307): stderr: | [0;m[1;31m20221209091708946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091708946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091708946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091708946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091708946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091708946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091708957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091708965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091708965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091708965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:11.795222 run osmo-msc_10.42.42.6(pid=19313): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19313)] 09:17:11.842622 run osmo-msc_10.42.42.6(pid=19313): stdout: | (launched: 2022-12-09_09:17:10.708345) 09:17:11.891781 run osmo-msc_10.42.42.6(pid=19313): stderr: | [0;m[38;5;43m20221209091710980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091710980 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa15273dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091710980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091710980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091710980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091710980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091710982 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091710982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091710983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091710983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:11.941209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19306): Terminating (SIGTERM) 09:17:11.981113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19309): Terminating (SIGTERM) 09:17:12.020904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19312): Terminating (SIGTERM) 09:17:12.061127 --- ParallelTerminationStrategy: PID 19306 died... 09:17:12.080261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19306): Terminated: ok {rc=0} 09:17:12.124141 --- ParallelTerminationStrategy: PID 19309 died... 09:17:12.142849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19309): Terminated: ok {rc=0} 09:17:12.186426 --- ParallelTerminationStrategy: PID 19312 died... 09:17:12.205022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19312): Terminated: ok {rc=0} 09:17:12.287823 bus /sierra_3: Setting Powered False 09:17:13.383579 bus /sierra_3: Setting Powered False 09:17:14.498018 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:17:15.643675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:15.655994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:17:15.722826 tst mo_mt_call_osmux.py: using LAC 20458 09:17:15.846743 tst mo_mt_call_osmux.py: using RAC 58 09:17:15.990890 tst mo_mt_call_osmux.py: using CellId 20458 09:17:16.141888 tst mo_mt_call_osmux.py: using BVCI 20459 09:17:16.298109 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:16.311216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:16.325489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:16.339606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:16.354069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:17:16.366879 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:17:16.495439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:17:16.620836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:17.108519 run create_hlr_db(pid=19315): Launched 09:17:17.257902 bus /sierra_2: Setting Powered False 09:17:18.318750 run create_hlr_db(pid=19315): Terminated: ok {rc=0} 09:17:18.745189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19317): Launched 09:17:19.051118 run osmo-hlr_10.42.42.2(pid=19318): Launched 09:17:19.168189 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:19.711929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19320): Launched 09:17:20.019438 run osmo-stp_10.42.42.5(pid=19321): Launched 09:17:20.138681 run osmo-msc_10.42.42.6: Starting osmo-msc 09:17:20.695465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19323): Launched 09:17:21.002074 run osmo-msc_10.42.42.6(pid=19324): Launched 09:17:21.173716 run osmo-stp_10.42.42.5(pid=19321): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19321)] 09:17:21.302561 run osmo-stp_10.42.42.5(pid=19321): stdout: | (launched: 2022-12-09_09:17:19.962722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:21.431100 run osmo-stp_10.42.42.5(pid=19321): stderr: | [0;m[38;5;43m20221209091720132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091720132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091720132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091720133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091720133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091720133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091720133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:21.558225 run osmo-stp_10.42.42.5(pid=19321): stdout: | (launched: 2022-12-09_09:17:19.962722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:21.680595 run osmo-stp_10.42.42.5(pid=19321): stderr: | [0;m[38;5;43m20221209091720132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091720132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091720132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091720133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091720133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091720133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091720133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:21.826594 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19321): Process ended prematurely: osmo-stp_10.42.42.5(pid=19321) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19321)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:17:21.835481 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:17:21.862010 run osmo-hlr_10.42.42.2(pid=19318): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19318)] 09:17:21.910173 run osmo-hlr_10.42.42.2(pid=19318): stdout: | (launched: 2022-12-09_09:17:18.994755) 09:17:21.959587 run osmo-hlr_10.42.42.2(pid=19318): stderr: | [0;m[1;31m20221209091719170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091719170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091719170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091719170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091719170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091719170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091719186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091719196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091719196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091719196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:22.028697 run osmo-msc_10.42.42.6(pid=19324): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19324)] 09:17:22.076655 run osmo-msc_10.42.42.6(pid=19324): stdout: | (launched: 2022-12-09_09:17:20.944706) 09:17:22.126169 run osmo-msc_10.42.42.6(pid=19324): stderr: | [0;m[38;5;43m20221209091721218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091721218 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbcf8bc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091721218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091721218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091721218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091721219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091721220 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091721221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091721221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091721221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:22.175983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19317): Terminating (SIGTERM) 09:17:22.215392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19320): Terminating (SIGTERM) 09:17:22.254724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19323): Terminating (SIGTERM) 09:17:22.294523 --- ParallelTerminationStrategy: PID 19317 died... 09:17:22.313713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19317): Terminated: ok {rc=0} 09:17:22.358056 --- ParallelTerminationStrategy: PID 19320 died... 09:17:22.376630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19320): Terminated: ok {rc=0} 09:17:22.420565 --- ParallelTerminationStrategy: PID 19323 died... 09:17:22.439237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19323): Terminated: ok {rc=0} 09:17:22.522821 bus /sierra_3: Setting Powered False 09:17:23.617563 bus /sierra_3: Setting Powered False 09:17:24.732765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:17:25.981798 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:25.988298 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:17:26.018168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:17:26.045385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:17:26.097130 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:17:26.126696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:17:26.153625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:17:26.708326 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:17:26.757122 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:26.768453 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:17:26.834323 tst mo_mt_call.py: using LAC 20459 09:17:26.956306 tst mo_mt_call.py: using RAC 59 09:17:27.077398 tst mo_mt_call.py: using CellId 20459 09:17:27.202004 tst mo_mt_call.py: using BVCI 20460 09:17:27.313834 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:27.325356 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:27.336597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:27.347893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:27.359168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:27.370458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:17:27.492110 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:17:27.612602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:28.089187 run create_hlr_db(pid=19329): Launched 09:17:28.213940 bus /sierra_2: Setting Powered False 09:17:29.274866 run create_hlr_db(pid=19329): Terminated: ok {rc=0} 09:17:29.721195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19331): Launched 09:17:30.052096 run osmo-hlr_10.42.42.2(pid=19332): Launched 09:17:30.178158 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:30.744939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19334): Launched 09:17:31.081700 run osmo-stp_10.42.42.5(pid=19335): Launched 09:17:31.322275 run osmo-msc_10.42.42.6: Starting osmo-msc 09:17:31.991872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19337): Launched 09:17:32.335795 run osmo-msc_10.42.42.6(pid=19338): Launched 09:17:32.521438 run osmo-stp_10.42.42.5(pid=19335): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19335)] 09:17:32.660220 run osmo-stp_10.42.42.5(pid=19335): stdout: | (launched: 2022-12-09_09:17:31.017376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:32.799785 run osmo-stp_10.42.42.5(pid=19335): stderr: | [0;m[38;5;43m20221209091731299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091731299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091731299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091731300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091731300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091731300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091731301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:32.937697 run osmo-stp_10.42.42.5(pid=19335): stdout: | (launched: 2022-12-09_09:17:31.017376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:33.069147 run osmo-stp_10.42.42.5(pid=19335): stderr: | [0;m[38;5;43m20221209091731299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091731299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091731299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091731300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091731300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091731300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091731301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:33.226183 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19335): Process ended prematurely: osmo-stp_10.42.42.5(pid=19335) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19335)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:17:33.235918 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:17:33.264694 run osmo-hlr_10.42.42.2(pid=19332): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19332)] 09:17:33.315136 run osmo-hlr_10.42.42.2(pid=19332): stdout: | (launched: 2022-12-09_09:17:29.991704) 09:17:33.367327 run osmo-hlr_10.42.42.2(pid=19332): stderr: | [0;m[1;31m20221209091730190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091730190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091730190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091730190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091730190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091730190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091730203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091730214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091730215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091730215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:33.440149 run osmo-msc_10.42.42.6(pid=19338): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19338)] 09:17:33.490295 run osmo-msc_10.42.42.6(pid=19338): stdout: | (launched: 2022-12-09_09:17:32.275469) 09:17:33.542442 run osmo-msc_10.42.42.6(pid=19338): stderr: | [0;m[38;5;43m20221209091732598 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091732598 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f48e730cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091732598 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091732598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091732598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091732598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091732600 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091732600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091732601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091732601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:33.595021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19331): Terminating (SIGTERM) 09:17:33.637127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19334): Terminating (SIGTERM) 09:17:33.678940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19337): Terminating (SIGTERM) 09:17:33.721557 --- ParallelTerminationStrategy: PID 19331 died... 09:17:33.741389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19331): Terminated: ok {rc=0} 09:17:33.787754 --- ParallelTerminationStrategy: PID 19334 died... 09:17:33.807596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19334): Terminated: ok {rc=0} 09:17:33.854590 --- ParallelTerminationStrategy: PID 19337 died... 09:17:33.874439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19337): Terminated: ok {rc=0} 09:17:33.962811 bus /sierra_3: Setting Powered False 09:17:35.062555 bus /sierra_3: Setting Powered False 09:17:36.178592 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:17:37.329432 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:37.342141 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:17:37.410646 tst mo_mt_call_osmux.py: using LAC 20460 09:17:37.538426 tst mo_mt_call_osmux.py: using RAC 60 09:17:37.667495 tst mo_mt_call_osmux.py: using CellId 20460 09:17:37.795535 tst mo_mt_call_osmux.py: using BVCI 20461 09:17:37.915103 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:37.927118 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:37.938947 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:37.950910 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:37.963291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:17:37.975442 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:17:38.097633 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:17:38.216377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:38.696009 run create_hlr_db(pid=19340): Launched 09:17:38.823014 bus /sierra_2: Setting Powered False 09:17:39.884436 run create_hlr_db(pid=19340): Terminated: ok {rc=0} 09:17:40.331363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19342): Launched 09:17:40.662887 run osmo-hlr_10.42.42.2(pid=19343): Launched 09:17:40.791248 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:41.361090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19345): Launched 09:17:41.690358 run osmo-stp_10.42.42.5(pid=19346): Launched 09:17:41.817253 run osmo-msc_10.42.42.6: Starting osmo-msc 09:17:42.410994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19348): Launched 09:17:42.740502 run osmo-msc_10.42.42.6(pid=19349): Launched 09:17:42.924160 run osmo-stp_10.42.42.5(pid=19346): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19346)] 09:17:43.062399 run osmo-stp_10.42.42.5(pid=19346): stdout: | (launched: 2022-12-09_09:17:41.629996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:43.201199 run osmo-stp_10.42.42.5(pid=19346): stderr: | [0;m[38;5;43m20221209091741823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091741823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091741823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091741823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091741824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091741824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091741824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:43.338634 run osmo-stp_10.42.42.5(pid=19346): stdout: | (launched: 2022-12-09_09:17:41.629996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:43.469607 run osmo-stp_10.42.42.5(pid=19346): stderr: | [0;m[38;5;43m20221209091741823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091741823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091741823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091741823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091741824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091741824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091741824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:43.626165 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19346): Process ended prematurely: osmo-stp_10.42.42.5(pid=19346) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19346)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:17:43.635768 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:17:43.664466 run osmo-hlr_10.42.42.2(pid=19343): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19343)] 09:17:43.714950 run osmo-hlr_10.42.42.2(pid=19343): stdout: | (launched: 2022-12-09_09:17:40.601982) 09:17:43.767308 run osmo-hlr_10.42.42.2(pid=19343): stderr: | [0;m[1;31m20221209091740799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091740799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091740799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091740799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091740799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091740799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091740811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091740820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091740820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091740820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:43.840763 run osmo-msc_10.42.42.6(pid=19349): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19349)] 09:17:43.891462 run osmo-msc_10.42.42.6(pid=19349): stdout: | (launched: 2022-12-09_09:17:42.680196) 09:17:43.943527 run osmo-msc_10.42.42.6(pid=19349): stderr: | [0;m[38;5;43m20221209091743002 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091743002 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50ad042c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091743002 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091743002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091743002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091743002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091743004 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091743004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091743004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091743005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:43.996203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19342): Terminating (SIGTERM) 09:17:44.038395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19345): Terminating (SIGTERM) 09:17:44.080562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19348): Terminating (SIGTERM) 09:17:44.123734 --- ParallelTerminationStrategy: PID 19342 died... 09:17:44.143987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19342): Terminated: ok {rc=0} 09:17:44.190968 --- ParallelTerminationStrategy: PID 19345 died... 09:17:44.210731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19345): Terminated: ok {rc=0} 09:17:44.257411 --- ParallelTerminationStrategy: PID 19348 died... 09:17:44.277162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19348): Terminated: ok {rc=0} 09:17:44.365590 bus /sierra_3: Setting Powered False 09:17:45.463621 bus /sierra_3: Setting Powered False 09:17:46.583468 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:17:47.837851 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:47.845631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:17:47.874986 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:17:47.902125 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:17:47.954940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:17:47.984756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:17:48.011815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:17:48.571885 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:17:48.620853 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:48.632341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:17:48.697355 tst mo_mt_call.py: using LAC 20461 09:17:48.815876 tst mo_mt_call.py: using RAC 61 09:17:48.934736 tst mo_mt_call.py: using CellId 20461 09:17:49.059313 tst mo_mt_call.py: using BVCI 20462 09:17:49.170958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:49.182369 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:49.193624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:49.204728 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:49.216211 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:49.227416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:17:49.348927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:17:49.467320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:49.944117 run create_hlr_db(pid=19354): Launched 09:17:50.068876 bus /sierra_2: Setting Powered False 09:17:51.130409 run create_hlr_db(pid=19354): Terminated: ok {rc=0} 09:17:51.557105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Launched 09:17:51.863999 run osmo-hlr_10.42.42.2(pid=19357): Launched 09:17:51.980770 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:52.507544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Launched 09:17:52.814544 run osmo-stp_10.42.42.5(pid=19360): Launched 09:17:52.934183 run osmo-msc_10.42.42.6: Starting osmo-msc 09:17:53.490768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19362): Launched 09:17:53.797662 run osmo-msc_10.42.42.6(pid=19363): Launched 09:17:53.969789 run osmo-stp_10.42.42.5(pid=19360): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] 09:17:54.099522 run osmo-stp_10.42.42.5(pid=19360): stdout: | (launched: 2022-12-09_09:17:52.757858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:54.228474 run osmo-stp_10.42.42.5(pid=19360): stderr: | [0;m[38;5;43m20221209091752928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091752928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091752928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091752929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091752929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091752929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091752929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:54.355711 run osmo-stp_10.42.42.5(pid=19360): stdout: | (launched: 2022-12-09_09:17:52.757858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:54.478021 run osmo-stp_10.42.42.5(pid=19360): stderr: | [0;m[38;5;43m20221209091752928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091752928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091752928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091752929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091752929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091752929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091752929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:54.624029 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19360): Process ended prematurely: osmo-stp_10.42.42.5(pid=19360) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:17:54.632908 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:17:54.659335 run osmo-hlr_10.42.42.2(pid=19357): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19357)] 09:17:54.707025 run osmo-hlr_10.42.42.2(pid=19357): stdout: | (launched: 2022-12-09_09:17:51.807453) 09:17:54.756540 run osmo-hlr_10.42.42.2(pid=19357): stderr: | [0;m[1;31m20221209091751984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091751984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091751984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091751984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091751984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091751984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091751996 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091752005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091752006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091752006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:54.825780 run osmo-msc_10.42.42.6(pid=19363): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19363)] 09:17:54.873419 run osmo-msc_10.42.42.6(pid=19363): stdout: | (launched: 2022-12-09_09:17:53.740788) 09:17:54.922736 run osmo-msc_10.42.42.6(pid=19363): stderr: | [0;m[38;5;43m20221209091754014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091754014 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff66e329c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091754014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091754014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091754015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091754015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091754016 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091754017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091754017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091754017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:17:54.972283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Terminating (SIGTERM) 09:17:55.011859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminating (SIGTERM) 09:17:55.051440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19362): Terminating (SIGTERM) 09:17:55.091475 --- ParallelTerminationStrategy: PID 19356 died... 09:17:55.110651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19356): Terminated: ok {rc=0} 09:17:55.154605 --- ParallelTerminationStrategy: PID 19359 died... 09:17:55.173303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminated: ok {rc=0} 09:17:55.217206 --- ParallelTerminationStrategy: PID 19362 died... 09:17:55.235788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19362): Terminated: ok {rc=0} 09:17:55.319275 bus /sierra_3: Setting Powered False 09:17:56.417228 bus /sierra_3: Setting Powered False 09:17:57.532578 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:17:58.675632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:58.687860 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:17:58.754382 tst mo_mt_call_osmux.py: using LAC 20462 09:17:58.876802 tst mo_mt_call_osmux.py: using RAC 62 09:17:58.997300 tst mo_mt_call_osmux.py: using CellId 20462 09:17:59.119731 tst mo_mt_call_osmux.py: using BVCI 20463 09:17:59.235635 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:59.246972 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:59.258149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:59.269391 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:59.280620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:17:59.291846 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:17:59.408510 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:17:59.530325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:00.042520 run create_hlr_db(pid=19365): Launched 09:18:00.169589 bus /sierra_2: Setting Powered False 09:18:01.231381 run create_hlr_db(pid=19365): Terminated: ok {rc=0} 09:18:01.675742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19367): Launched 09:18:02.000914 run osmo-hlr_10.42.42.2(pid=19368): Launched 09:18:02.171803 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:02.756055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19370): Launched 09:18:03.086744 run osmo-stp_10.42.42.5(pid=19371): Launched 09:18:03.212150 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:03.806504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19373): Launched 09:18:04.138791 run osmo-msc_10.42.42.6(pid=19374): Launched 09:18:04.325163 run osmo-stp_10.42.42.5(pid=19371): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19371)] 09:18:04.467368 run osmo-stp_10.42.42.5(pid=19371): stdout: | (launched: 2022-12-09_09:18:03.026727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:04.608345 run osmo-stp_10.42.42.5(pid=19371): stderr: | [0;m[38;5;43m20221209091803219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091803219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091803219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091803220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091803220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091803220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091803220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:04.746532 run osmo-stp_10.42.42.5(pid=19371): stdout: | (launched: 2022-12-09_09:18:03.026727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:04.878835 run osmo-stp_10.42.42.5(pid=19371): stderr: | [0;m[38;5;43m20221209091803219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091803219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091803219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091803220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091803220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091803220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091803220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:05.036237 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19371): Process ended prematurely: osmo-stp_10.42.42.5(pid=19371) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19371)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:18:05.046027 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:18:05.074830 run osmo-hlr_10.42.42.2(pid=19368): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19368)] 09:18:05.125526 run osmo-hlr_10.42.42.2(pid=19368): stdout: | (launched: 2022-12-09_09:18:01.943576) 09:18:05.177817 run osmo-hlr_10.42.42.2(pid=19368): stderr: | [0;m[1;31m20221209091802256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091802256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091802256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091802256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091802256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091802256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091802271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091802279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091802279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091802279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:05.250661 run osmo-msc_10.42.42.6(pid=19374): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19374)] 09:18:05.301179 run osmo-msc_10.42.42.6(pid=19374): stdout: | (launched: 2022-12-09_09:18:04.078332) 09:18:05.353249 run osmo-msc_10.42.42.6(pid=19374): stderr: | [0;m[38;5;43m20221209091804400 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091804400 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f704665ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091804400 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091804400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091804401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091804401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091804403 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091804403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091804403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091804403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:05.405722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19367): Terminating (SIGTERM) 09:18:05.447775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19370): Terminating (SIGTERM) 09:18:05.489927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19373): Terminating (SIGTERM) 09:18:05.532483 --- ParallelTerminationStrategy: PID 19367 died... 09:18:05.552709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19367): Terminated: ok {rc=0} 09:18:05.599843 --- ParallelTerminationStrategy: PID 19370 died... 09:18:05.619653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19370): Terminated: ok {rc=0} 09:18:05.666292 --- ParallelTerminationStrategy: PID 19373 died... 09:18:05.686134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19373): Terminated: ok {rc=0} 09:18:05.774369 bus /sierra_3: Setting Powered False 09:18:06.875739 bus /sierra_3: Setting Powered False 09:18:07.993864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:18:09.246772 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:09.253902 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:18:09.285366 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:18:09.313139 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:18:09.366781 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:18:09.397619 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:18:09.425692 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:18:09.985201 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:18:10.039541 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:10.051798 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:18:10.119870 tst mo_mt_call.py: using LAC 20463 09:18:10.249638 tst mo_mt_call.py: using RAC 63 09:18:10.376482 tst mo_mt_call.py: using CellId 20463 09:18:10.505383 tst mo_mt_call.py: using BVCI 20464 09:18:10.626240 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:10.638432 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:10.650332 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:10.662483 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:10.674610 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:10.686691 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:18:10.806855 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:18:10.929832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:11.407912 run create_hlr_db(pid=19379): Launched 09:18:11.534482 bus /sierra_2: Setting Powered False 09:18:12.595570 run create_hlr_db(pid=19379): Terminated: ok {rc=0} 09:18:13.044608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19381): Launched 09:18:13.374649 run osmo-hlr_10.42.42.2(pid=19382): Launched 09:18:13.501040 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:14.069514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19384): Launched 09:18:14.398050 run osmo-stp_10.42.42.5(pid=19385): Launched 09:18:14.525382 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:15.121660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19387): Launched 09:18:15.451410 run osmo-msc_10.42.42.6(pid=19388): Launched 09:18:15.636651 run osmo-stp_10.42.42.5(pid=19385): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19385)] 09:18:15.774691 run osmo-stp_10.42.42.5(pid=19385): stdout: | (launched: 2022-12-09_09:18:14.337992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:15.937342 run osmo-stp_10.42.42.5(pid=19385): stderr: | [0;m[38;5;43m20221209091814531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091814531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091814531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091814532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091814532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091814532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091814532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:16.122104 run osmo-stp_10.42.42.5(pid=19385): stdout: | (launched: 2022-12-09_09:18:14.337992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:16.256242 run osmo-stp_10.42.42.5(pid=19385): stderr: | [0;m[38;5;43m20221209091814531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091814531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091814531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091814532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091814532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091814532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091814532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:16.416847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19385): Process ended prematurely: osmo-stp_10.42.42.5(pid=19385) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19385)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:18:16.427403 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:18:16.458995 run osmo-hlr_10.42.42.2(pid=19382): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19382)] 09:18:16.511671 run osmo-hlr_10.42.42.2(pid=19382): stdout: | (launched: 2022-12-09_09:18:13.313871) 09:18:16.565974 run osmo-hlr_10.42.42.2(pid=19382): stderr: | [0;m[1;31m20221209091813513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091813514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091813514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091813514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091813514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091813514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091813527 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091813537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091813537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091813537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:16.641425 run osmo-msc_10.42.42.6(pid=19388): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19388)] 09:18:16.694009 run osmo-msc_10.42.42.6(pid=19388): stdout: | (launched: 2022-12-09_09:18:15.390936) 09:18:16.748430 run osmo-msc_10.42.42.6(pid=19388): stderr: | [0;m[38;5;43m20221209091815713 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091815714 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f46081e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091815714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091815714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091815714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091815714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091815716 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091815716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091815716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091815716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:16.803127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19381): Terminating (SIGTERM) 09:18:16.847768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19384): Terminating (SIGTERM) 09:18:16.892079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19387): Terminating (SIGTERM) 09:18:16.936901 --- ParallelTerminationStrategy: PID 19381 died... 09:18:16.957705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19381): Terminated: ok {rc=0} 09:18:17.007496 --- ParallelTerminationStrategy: PID 19384 died... 09:18:17.028298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19384): Terminated: ok {rc=0} 09:18:17.077947 --- ParallelTerminationStrategy: PID 19387 died... 09:18:17.098759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19387): Terminated: ok {rc=0} 09:18:17.189933 bus /sierra_3: Setting Powered False 09:18:18.291378 bus /sierra_3: Setting Powered False 09:18:19.409215 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:18:20.555230 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:20.567663 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:18:20.634925 tst mo_mt_call_osmux.py: using LAC 20464 09:18:20.754286 tst mo_mt_call_osmux.py: using RAC 64 09:18:20.883332 tst mo_mt_call_osmux.py: using CellId 20464 09:18:21.010810 tst mo_mt_call_osmux.py: using BVCI 20465 09:18:21.130472 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:21.142750 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:21.154825 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:21.167124 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:21.180024 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:18:21.192438 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:18:21.315857 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:18:21.435371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:21.912555 run create_hlr_db(pid=19390): Launched 09:18:22.037326 bus /sierra_2: Setting Powered False 09:18:23.098991 run create_hlr_db(pid=19390): Terminated: ok {rc=0} 09:18:23.525706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19392): Launched 09:18:23.831806 run osmo-hlr_10.42.42.2(pid=19393): Launched 09:18:23.948816 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:24.476181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19395): Launched 09:18:24.783644 run osmo-stp_10.42.42.5(pid=19396): Launched 09:18:24.904641 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:25.461259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19398): Launched 09:18:25.791168 run osmo-msc_10.42.42.6(pid=19399): Launched 09:18:25.978022 run osmo-stp_10.42.42.5(pid=19396): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19396)] 09:18:26.116558 run osmo-stp_10.42.42.5(pid=19396): stdout: | (launched: 2022-12-09_09:18:24.726582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:26.255959 run osmo-stp_10.42.42.5(pid=19396): stderr: | [0;m[38;5;43m20221209091824898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091824898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091824898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091824898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091824899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091824899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091824899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:26.393564 run osmo-stp_10.42.42.5(pid=19396): stdout: | (launched: 2022-12-09_09:18:24.726582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:26.525961 run osmo-stp_10.42.42.5(pid=19396): stderr: | [0;m[38;5;43m20221209091824898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091824898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091824898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091824898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091824899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091824899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091824899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:26.683351 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19396): Process ended prematurely: osmo-stp_10.42.42.5(pid=19396) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19396)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:18:26.693217 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:18:26.722456 run osmo-hlr_10.42.42.2(pid=19393): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19393)] 09:18:26.773418 run osmo-hlr_10.42.42.2(pid=19393): stdout: | (launched: 2022-12-09_09:18:23.775328) 09:18:26.826205 run osmo-hlr_10.42.42.2(pid=19393): stderr: | [0;m[1;31m20221209091823950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091823950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091823950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091823950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091823950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091823950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091823962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091823971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091823971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091823971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:26.900039 run osmo-msc_10.42.42.6(pid=19399): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19399)] 09:18:26.951030 run osmo-msc_10.42.42.6(pid=19399): stdout: | (launched: 2022-12-09_09:18:25.731280) 09:18:27.003836 run osmo-msc_10.42.42.6(pid=19399): stderr: | [0;m[38;5;43m20221209091826052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091826052 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f073426fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091826052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091826052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091826052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091826052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091826054 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091826054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091826055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091826055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:27.057082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19392): Terminating (SIGTERM) 09:18:27.099847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19395): Terminating (SIGTERM) 09:18:27.142471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19398): Terminating (SIGTERM) 09:18:27.185598 --- ParallelTerminationStrategy: PID 19392 died... 09:18:27.205948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19392): Terminated: ok {rc=0} 09:18:27.253480 --- ParallelTerminationStrategy: PID 19395 died... 09:18:27.273456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19395): Terminated: ok {rc=0} 09:18:27.320719 --- ParallelTerminationStrategy: PID 19398 died... 09:18:27.340667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19398): Terminated: ok {rc=0} 09:18:27.429321 bus /sierra_3: Setting Powered False 09:18:28.528004 bus /sierra_3: Setting Powered False 09:18:29.643271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:18:30.907720 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:30.917129 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:18:30.959691 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:18:30.990362 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:18:31.051835 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:18:31.095262 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:18:31.133575 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:18:31.679528 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:18:31.746050 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:31.759303 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:18:31.838097 tst mo_mt_call.py: using LAC 20465 09:18:31.995031 tst mo_mt_call.py: using RAC 65 09:18:32.126936 tst mo_mt_call.py: using CellId 20465 09:18:32.281380 tst mo_mt_call.py: using BVCI 20466 09:18:32.405453 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:32.417543 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:32.429301 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:32.441695 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:32.453628 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:32.465507 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:18:32.584336 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:18:32.704192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:33.214535 run create_hlr_db(pid=19404): Launched 09:18:33.338821 bus /sierra_2: Setting Powered False 09:18:34.403523 run create_hlr_db(pid=19404): Terminated: ok {rc=0} 09:18:34.841652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19406): Launched 09:18:35.150373 run osmo-hlr_10.42.42.2(pid=19407): Launched 09:18:35.268901 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:35.809183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19409): Launched 09:18:36.115871 run osmo-stp_10.42.42.5(pid=19410): Launched 09:18:36.232933 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:36.787841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19412): Launched 09:18:37.097084 run osmo-msc_10.42.42.6(pid=19413): Launched 09:18:37.270195 run osmo-stp_10.42.42.5(pid=19410): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19410)] 09:18:37.399688 run osmo-stp_10.42.42.5(pid=19410): stdout: | (launched: 2022-12-09_09:18:36.059258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:37.529237 run osmo-stp_10.42.42.5(pid=19410): stderr: | [0;m[38;5;43m20221209091836230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091836230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091836230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091836230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091836231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091836231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091836231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:37.656925 run osmo-stp_10.42.42.5(pid=19410): stdout: | (launched: 2022-12-09_09:18:36.059258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:37.780093 run osmo-stp_10.42.42.5(pid=19410): stderr: | [0;m[38;5;43m20221209091836230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091836230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091836230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091836230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091836231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091836231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091836231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:37.927317 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19410): Process ended prematurely: osmo-stp_10.42.42.5(pid=19410) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19410)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:18:37.936400 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:18:37.963622 run osmo-hlr_10.42.42.2(pid=19407): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19407)] 09:18:38.012070 run osmo-hlr_10.42.42.2(pid=19407): stdout: | (launched: 2022-12-09_09:18:35.093776) 09:18:38.062093 run osmo-hlr_10.42.42.2(pid=19407): stderr: | [0;m[1;31m20221209091835268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091835268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091835268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091835268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091835268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091835268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091835280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091835289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091835289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091835289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:38.131848 run osmo-msc_10.42.42.6(pid=19413): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19413)] 09:18:38.180529 run osmo-msc_10.42.42.6(pid=19413): stdout: | (launched: 2022-12-09_09:18:37.039174) 09:18:38.230629 run osmo-msc_10.42.42.6(pid=19413): stderr: | [0;m[38;5;43m20221209091837310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091837310 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc1b6407c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091837310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091837310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091837310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091837311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091837312 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091837313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091837313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091837313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:38.280983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19406): Terminating (SIGTERM) 09:18:38.321493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19409): Terminating (SIGTERM) 09:18:38.361730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19412): Terminating (SIGTERM) 09:18:38.402435 --- ParallelTerminationStrategy: PID 19406 died... 09:18:38.421847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19406): Terminated: ok {rc=0} 09:18:38.466351 --- ParallelTerminationStrategy: PID 19409 died... 09:18:38.485448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19409): Terminated: ok {rc=0} 09:18:38.530048 --- ParallelTerminationStrategy: PID 19412 died... 09:18:38.549064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19412): Terminated: ok {rc=0} 09:18:38.635819 bus /sierra_3: Setting Powered False 09:18:39.735794 bus /sierra_3: Setting Powered False 09:18:40.851713 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:18:41.999275 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:42.011523 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:18:42.079697 tst mo_mt_call_osmux.py: using LAC 20466 09:18:42.200438 tst mo_mt_call_osmux.py: using RAC 66 09:18:42.329339 tst mo_mt_call_osmux.py: using CellId 20466 09:18:42.459996 tst mo_mt_call_osmux.py: using BVCI 20467 09:18:42.579667 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:42.591720 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:42.603485 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:42.616194 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:42.628773 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:18:42.640533 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:18:42.758419 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:18:42.880910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:43.363287 run create_hlr_db(pid=19415): Launched 09:18:43.488423 bus /sierra_2: Setting Powered False 09:18:44.550393 run create_hlr_db(pid=19415): Terminated: ok {rc=0} 09:18:44.998638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Launched 09:18:45.328134 run osmo-hlr_10.42.42.2(pid=19418): Launched 09:18:45.453830 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:46.048532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Launched 09:18:46.397173 run osmo-stp_10.42.42.5(pid=19421): Launched 09:18:46.718126 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:47.313535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Launched 09:18:47.621244 run osmo-msc_10.42.42.6(pid=19424): Launched 09:18:47.794183 run osmo-stp_10.42.42.5(pid=19421): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] 09:18:47.925264 run osmo-stp_10.42.42.5(pid=19421): stdout: | (launched: 2022-12-09_09:18:46.331011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:48.053975 run osmo-stp_10.42.42.5(pid=19421): stderr: | [0;m[38;5;43m20221209091846577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091846577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091846577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091846578 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091846578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091846578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091846578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:48.181711 run osmo-stp_10.42.42.5(pid=19421): stdout: | (launched: 2022-12-09_09:18:46.331011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:48.304445 run osmo-stp_10.42.42.5(pid=19421): stderr: | [0;m[38;5;43m20221209091846577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091846577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091846577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091846578 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091846578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091846578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091846578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:48.451271 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19421): Process ended prematurely: osmo-stp_10.42.42.5(pid=19421) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:18:48.460326 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:18:48.487116 run osmo-hlr_10.42.42.2(pid=19418): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19418)] 09:18:48.535057 run osmo-hlr_10.42.42.2(pid=19418): stdout: | (launched: 2022-12-09_09:18:45.267479) 09:18:48.584443 run osmo-hlr_10.42.42.2(pid=19418): stderr: | [0;m[1;31m20221209091845464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091845464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091845464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091845464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091845464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091845465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091845477 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091845486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091845486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091845486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:48.653698 run osmo-msc_10.42.42.6(pid=19424): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19424)] 09:18:48.700911 run osmo-msc_10.42.42.6(pid=19424): stdout: | (launched: 2022-12-09_09:18:47.564401) 09:18:48.749776 run osmo-msc_10.42.42.6(pid=19424): stderr: | [0;m[38;5;43m20221209091847835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091847835 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54d3f53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091847835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091847835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091847835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091847836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091847838 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091847839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091847839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091847839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:18:48.799223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Terminating (SIGTERM) 09:18:48.839374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Terminating (SIGTERM) 09:18:48.879503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Terminating (SIGTERM) 09:18:48.919847 --- ParallelTerminationStrategy: PID 19417 died... 09:18:48.939076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19417): Terminated: ok {rc=0} 09:18:48.982972 --- ParallelTerminationStrategy: PID 19420 died... 09:18:49.001564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19420): Terminated: ok {rc=0} 09:18:49.046619 --- ParallelTerminationStrategy: PID 19423 died... 09:18:49.065260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19423): Terminated: ok {rc=0} 09:18:49.150832 bus /sierra_3: Setting Powered False 09:18:50.250505 bus /sierra_3: Setting Powered False 09:18:51.365180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 09:18:52.612557 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:52.618436 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:18:52.650797 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:18:52.678930 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:18:52.767679 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:18:52.798248 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:18:52.826379 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:18:53.416214 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 09:18:53.422300 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:53.433515 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:18:53.480485 tst emergency_mo_mt_call.py: using LAC 20467 09:18:53.599650 tst emergency_mo_mt_call.py: using RAC 67 09:18:53.719289 tst emergency_mo_mt_call.py: using CellId 20467 09:18:53.847259 tst emergency_mo_mt_call.py: using BVCI 20468 09:18:53.965090 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:53.976720 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:53.987995 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:54.000201 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:54.012407 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:18:54.024528 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:18:54.144103 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:18:54.262664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:54.731023 run create_hlr_db(pid=19430): Launched 09:18:54.854939 bus /sierra_2: Setting Powered False 09:18:55.915777 run create_hlr_db(pid=19430): Terminated: ok {rc=0} 09:18:56.358137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19432): Launched 09:18:56.683117 run osmo-hlr_10.42.42.2(pid=19433): Launched 09:18:56.808880 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:57.365507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19435): Launched 09:18:57.687027 run osmo-stp_10.42.42.5(pid=19436): Launched 09:18:57.821158 tst emergency_mo_mt_call.py: using MSISDN 7129 09:18:57.988151 run osmo-msc_10.42.42.6: Starting osmo-msc 09:18:58.571172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19438): Launched 09:18:58.896593 run osmo-msc_10.42.42.6(pid=19439): Launched 09:18:59.079520 run osmo-stp_10.42.42.5(pid=19436): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19436)] 09:18:59.216167 run osmo-stp_10.42.42.5(pid=19436): stdout: | (launched: 2022-12-09_09:18:57.627557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:59.353804 run osmo-stp_10.42.42.5(pid=19436): stderr: | [0;m[38;5;43m20221209091857818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091857818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091857819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091857819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091857819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091857820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091857820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:59.489035 run osmo-stp_10.42.42.5(pid=19436): stdout: | (launched: 2022-12-09_09:18:57.627557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:59.617998 run osmo-stp_10.42.42.5(pid=19436): stderr: | [0;m[38;5;43m20221209091857818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091857818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091857819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091857819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091857819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091857820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091857820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:59.772147 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19436): Process ended prematurely: osmo-stp_10.42.42.5(pid=19436) [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19436)] [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 09:18:59.781359 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 09:18:59.809970 run osmo-hlr_10.42.42.2(pid=19433): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19433)] 09:18:59.861686 run osmo-hlr_10.42.42.2(pid=19433): stdout: | (launched: 2022-12-09_09:18:56.623483) 09:18:59.914250 run osmo-hlr_10.42.42.2(pid=19433): stderr: | [0;m[1;31m20221209091856820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091856820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091856820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091856820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091856820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091856820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091856832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091856841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091856841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091856841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:59.987049 run osmo-msc_10.42.42.6(pid=19439): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19439)] 09:19:00.038376 run osmo-msc_10.42.42.6(pid=19439): stdout: | (launched: 2022-12-09_09:18:58.836662) 09:19:00.091060 run osmo-msc_10.42.42.6(pid=19439): stderr: | [0;m[38;5;43m20221209091859157 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091859158 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4a24a00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091859158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091859158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091859158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091859158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091859160 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091859160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091859160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091859160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:00.144062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19432): Terminating (SIGTERM) 09:19:00.186483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19435): Terminating (SIGTERM) 09:19:00.229119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19438): Terminating (SIGTERM) 09:19:00.271754 --- ParallelTerminationStrategy: PID 19432 died... 09:19:00.292007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19432): Terminated: ok {rc=0} 09:19:00.339680 --- ParallelTerminationStrategy: PID 19435 died... 09:19:00.359794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19435): Terminated: ok {rc=0} 09:19:00.406835 --- ParallelTerminationStrategy: PID 19438 died... 09:19:00.426771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19438): Terminated: ok {rc=0} 09:19:00.515530 bus /sierra_3: Setting Powered False 09:19:01.613535 bus /sierra_3: Setting Powered False 09:19:02.727463 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 09:19:03.814132 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:19:03.826657 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:19:03.877309 tst emergency_preemptive_call.py: using LAC 20468 09:19:04.005232 tst emergency_preemptive_call.py: using RAC 68 09:19:04.131130 tst emergency_preemptive_call.py: using CellId 20468 09:19:04.256715 tst emergency_preemptive_call.py: using BVCI 20469 09:19:04.375460 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:19:04.387193 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:19:04.398505 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:19:04.410242 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:19:04.422033 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:19:04.433689 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:04.552477 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:04.671031 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:04.790144 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:04.908698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:05.413091 run create_hlr_db(pid=19441): Launched 09:19:05.538431 bus /sierra_2: Setting Powered False 09:19:06.602577 run create_hlr_db(pid=19441): Terminated: ok {rc=0} 09:19:07.054941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19443): Launched 09:19:07.380121 run osmo-hlr_10.42.42.2(pid=19444): Launched 09:19:07.504138 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:08.060553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19446): Launched 09:19:08.383573 run osmo-stp_10.42.42.5(pid=19447): Launched 09:19:08.516539 tst emergency_preemptive_call.py: using MSISDN 7130 09:19:08.682146 run osmo-msc_10.42.42.6: Starting osmo-msc 09:19:09.262463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19449): Launched 09:19:09.586539 run osmo-msc_10.42.42.6(pid=19450): Launched 09:19:09.768736 run osmo-stp_10.42.42.5(pid=19447): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19447)] 09:19:09.906381 run osmo-stp_10.42.42.5(pid=19447): stdout: | (launched: 2022-12-09_09:19:08.323905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:10.043788 run osmo-stp_10.42.42.5(pid=19447): stderr: | [0;m[38;5;43m20221209091908515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091908515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091908516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091908516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091908517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091908517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091908517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:10.179669 run osmo-stp_10.42.42.5(pid=19447): stdout: | (launched: 2022-12-09_09:19:08.323905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:10.308267 run osmo-stp_10.42.42.5(pid=19447): stderr: | [0;m[38;5;43m20221209091908515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091908515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091908516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091908516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091908517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091908517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091908517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:10.462445 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19447): Process ended prematurely: osmo-stp_10.42.42.5(pid=19447) [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19447)] [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 09:19:10.471679 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 09:19:10.500431 run osmo-hlr_10.42.42.2(pid=19444): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19444)] 09:19:10.551306 run osmo-hlr_10.42.42.2(pid=19444): stdout: | (launched: 2022-12-09_09:19:07.319900) 09:19:10.603973 run osmo-hlr_10.42.42.2(pid=19444): stderr: | [0;m[1;31m20221209091907518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091907518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091907518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091907518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091907518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091907518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091907531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091907539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091907540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091907540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:10.677334 run osmo-msc_10.42.42.6(pid=19450): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19450)] 09:19:10.728193 run osmo-msc_10.42.42.6(pid=19450): stdout: | (launched: 2022-12-09_09:19:09.526820) 09:19:10.780625 run osmo-msc_10.42.42.6(pid=19450): stderr: | [0;m[38;5;43m20221209091909847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209091909847 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb6880bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209091909847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209091909847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209091909848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209091909848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209091909850 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209091909850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209091909850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209091909850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:19:10.833777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19443): Terminating (SIGTERM) 09:19:10.876724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19446): Terminating (SIGTERM) 09:19:10.919399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19449): Terminating (SIGTERM) 09:19:10.962554 --- ParallelTerminationStrategy: PID 19443 died... 09:19:10.982784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19443): Terminated: ok {rc=0} 09:19:11.030069 --- ParallelTerminationStrategy: PID 19446 died... 09:19:11.049908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19446): Terminated: ok {rc=0} 09:19:11.096811 --- ParallelTerminationStrategy: PID 19449 died... 09:19:11.116916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19449): Terminated: ok {rc=0} 09:19:11.206233 bus /sierra_9: Setting Powered False 09:19:12.302503 bus /sierra_9: Setting Powered False 09:19:13.417511 bus /sierra_8: Setting Powered False 09:19:14.515896 bus /sierra_8: Setting Powered False 09:19:15.631517 bus /sierra_3: Setting Powered False 09:19:16.727674 bus /sierra_3: Setting Powered False 09:19:17.847331 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 09:19:19.128360 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:19:19.132616 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:19:19.162168 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 09:19:19.201176 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:19:19.287823 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:19:19.317361 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 09:19:19.356195 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:19:19.952219 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 09:19:20.002196 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.013236 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:19:20.056776 tst cs_paging_gprs_active.py: using LAC 20469 09:19:20.175796 tst cs_paging_gprs_active.py: using RAC 69 09:19:20.298008 tst cs_paging_gprs_active.py: using CellId 20469 09:19:20.418373 tst cs_paging_gprs_active.py: using BVCI 20470 09:19:20.531365 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.542378 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.553208 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.563888 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.574553 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.585190 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.595976 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.606956 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:20.617792 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:20.738152 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:20.856435 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:19:21.063245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:21.373294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19455): Launched 09:19:21.641659 run iperf3-srv_10.42.42.10(pid=19456): Launched 09:19:21.755881 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:19:21.961809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:22.270662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19457): Launched 09:19:22.538096 run iperf3-srv_10.42.42.10(pid=19458): Launched 09:19:22.654803 tst cs_paging_gprs_active.py:38: start network... 09:19:22.860406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:23.336822 run create_hlr_db(pid=19459): Launched 09:19:23.461701 bus /sierra_2: Setting Powered False 09:19:24.523378 run create_hlr_db(pid=19459): Terminated: ok {rc=0} 09:19:24.971273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19461): Launched 09:19:25.302921 run osmo-hlr_10.42.42.2(pid=19462): Launched 09:19:25.431110 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:25.997943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19464): Launched 09:19:26.329255 run osmo-stp_10.42.42.5(pid=19465): Launched 09:19:26.455176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:27.023719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19467): Launched 09:19:27.151605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:27.430477 run patchelf(pid=19468): Launched 09:19:27.613632 run osmo-stp_10.42.42.5(pid=19465): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19465)] 09:19:27.752213 run osmo-stp_10.42.42.5(pid=19465): stdout: | (launched: 2022-12-09_09:19:26.268636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:27.892740 run osmo-stp_10.42.42.5(pid=19465): stderr: | [0;m[38;5;43m20221209091926461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091926461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091926461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091926462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091926462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091926462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091926462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:28.032892 run osmo-stp_10.42.42.5(pid=19465): stdout: | (launched: 2022-12-09_09:19:26.268636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:28.167533 run osmo-stp_10.42.42.5(pid=19465): stderr: | [0;m[38;5;43m20221209091926461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091926461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091926461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091926462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091926462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091926462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091926462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:28.326965 run patchelf(pid=19468): Terminating (SIGINT) 09:19:28.510887 run patchelf(pid=19468): Terminated: ok {rc=0} 09:19:28.643341 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19465): Process ended prematurely: osmo-stp_10.42.42.5(pid=19465) [trial-2357↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19465)] [trial-2357↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 09:19:28.653611 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:19:28.683182 run osmo-hlr_10.42.42.2(pid=19462): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19462)] 09:19:28.733576 run osmo-hlr_10.42.42.2(pid=19462): stdout: | (launched: 2022-12-09_09:19:25.242545) 09:19:28.785613 run osmo-hlr_10.42.42.2(pid=19462): stderr: | [0;m[1;31m20221209091925439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091925439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091925439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091925439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091925439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091925439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091925451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091925459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091925460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091925460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:28.838065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19455): Terminating (SIGTERM) 09:19:28.880733 run iperf3-srv_10.42.42.10(pid=19456): Terminating (SIGTERM) 09:19:28.923637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19457): Terminating (SIGTERM) 09:19:28.965874 run iperf3-srv_10.42.42.10(pid=19458): Terminating (SIGTERM) 09:19:29.007863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19461): Terminating (SIGTERM) 09:19:29.050151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19464): Terminating (SIGTERM) 09:19:29.092334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19467): Terminating (SIGTERM) 09:19:29.135007 --- ParallelTerminationStrategy: PID 19455 died... 09:19:29.154965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19455): Terminated: ok {rc=0} 09:19:29.202079 --- ParallelTerminationStrategy: PID 19456 died... 09:19:29.221801 run iperf3-srv_10.42.42.10(pid=19456): Terminated {rc=256} 09:19:29.268586 --- ParallelTerminationStrategy: PID 19457 died... 09:19:29.288337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19457): Terminated: ok {rc=0} 09:19:29.335203 --- ParallelTerminationStrategy: PID 19458 died... 09:19:29.354966 run iperf3-srv_10.42.42.10(pid=19458): Terminated {rc=256} 09:19:29.401884 --- ParallelTerminationStrategy: PID 19461 died... 09:19:29.421707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19461): Terminated: ok {rc=0} 09:19:29.468426 --- ParallelTerminationStrategy: PID 19464 died... 09:19:29.488304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19464): Terminated: ok {rc=0} 09:19:29.535362 --- ParallelTerminationStrategy: PID 19467 died... 09:19:29.555135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19467): Terminated: ok {rc=0} 09:19:29.643178 bus /gobi_0: Setting Powered False 09:19:30.743770 bus /gobi_0: Setting Powered False 09:19:31.864627 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 09:19:33.017881 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.029679 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:19:33.077276 tst iperf3.py: using LAC 20470 09:19:33.198693 tst iperf3.py: using RAC 70 09:19:33.320632 tst iperf3.py: using CellId 20470 09:19:33.445629 tst iperf3.py: using BVCI 20471 09:19:33.558783 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.569984 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.580829 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.591746 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.602554 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.613347 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.624237 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.635031 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:33.645920 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:33.763861 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:19:33.970398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:34.279026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19469): Launched 09:19:34.547104 run iperf3-srv_10.42.42.10(pid=19470): Launched 09:19:34.661887 tst iperf3.py:8: start network... 09:19:34.867457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:35.345173 run create_hlr_db(pid=19471): Launched 09:19:35.469220 bus /gobi_6: Setting Powered False 09:19:36.530810 run create_hlr_db(pid=19471): Terminated: ok {rc=0} 09:19:36.957350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19473): Launched 09:19:37.264099 run osmo-hlr_10.42.42.2(pid=19474): Launched 09:19:37.382311 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:37.914268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19476): Launched 09:19:38.221478 run osmo-stp_10.42.42.5(pid=19477): Launched 09:19:38.339994 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:38.869359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19479): Launched 09:19:38.985711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:39.245071 run patchelf(pid=19480): Launched 09:19:39.415323 run osmo-stp_10.42.42.5(pid=19477): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19477)] 09:19:39.544497 run osmo-stp_10.42.42.5(pid=19477): stdout: | (launched: 2022-12-09_09:19:38.164467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:39.676325 run osmo-stp_10.42.42.5(pid=19477): stderr: | [0;m[38;5;43m20221209091938332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091938332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091938332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091938333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091938333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091938333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091938334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:39.807532 run osmo-stp_10.42.42.5(pid=19477): stdout: | (launched: 2022-12-09_09:19:38.164467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:39.933429 run osmo-stp_10.42.42.5(pid=19477): stderr: | [0;m[38;5;43m20221209091938332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091938332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091938332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091938333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091938333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091938333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091938334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:40.082202 run patchelf(pid=19480): Terminating (SIGINT) 09:19:40.254541 run patchelf(pid=19480): Terminated: ok {rc=0} 09:19:40.378116 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19477): Process ended prematurely: osmo-stp_10.42.42.5(pid=19477) [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19477)] [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 09:19:40.387519 tst iperf3.py:8: Test FAILED (7.4 sec) 09:19:40.414837 run osmo-hlr_10.42.42.2(pid=19474): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19474)] 09:19:40.462479 run osmo-hlr_10.42.42.2(pid=19474): stdout: | (launched: 2022-12-09_09:19:37.207390) 09:19:40.511742 run osmo-hlr_10.42.42.2(pid=19474): stderr: | [0;m[1;31m20221209091937381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091937381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091937381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091937381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091937381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091937381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091937393 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091937402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091937402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091937402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:40.561351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19469): Terminating (SIGTERM) 09:19:40.601153 run iperf3-srv_10.42.42.10(pid=19470): Terminating (SIGTERM) 09:19:40.640724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19473): Terminating (SIGTERM) 09:19:40.680580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19476): Terminating (SIGTERM) 09:19:40.720444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19479): Terminating (SIGTERM) 09:19:40.760872 --- ParallelTerminationStrategy: PID 19469 died... 09:19:40.780334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19469): Terminated: ok {rc=0} 09:19:40.825173 --- ParallelTerminationStrategy: PID 19470 died... 09:19:40.844221 run iperf3-srv_10.42.42.10(pid=19470): Terminated {rc=256} 09:19:40.888599 --- ParallelTerminationStrategy: PID 19473 died... 09:19:40.907643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19473): Terminated: ok {rc=0} 09:19:40.952198 --- ParallelTerminationStrategy: PID 19476 died... 09:19:40.971305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19476): Terminated: ok {rc=0} 09:19:41.015715 --- ParallelTerminationStrategy: PID 19479 died... 09:19:41.034674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19479): Terminated: ok {rc=0} 09:19:41.120479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 09:19:42.268773 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.280514 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:19:42.332516 tst iperf3m4.py: using LAC 20471 09:19:42.467893 tst iperf3m4.py: using RAC 71 09:19:42.589995 tst iperf3m4.py: using CellId 20471 09:19:42.710678 tst iperf3m4.py: using BVCI 20472 09:19:42.823616 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.834777 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.845676 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.856479 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.867379 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.878231 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.889200 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.899891 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:19:42.910824 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:43.032804 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:43.154265 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:43.275553 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:19:43.399902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:19:43.607438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:43.916522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19481): Launched 09:19:44.184445 run iperf3-srv_10.42.42.10(pid=19482): Launched 09:19:44.300097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:19:44.506683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:44.815734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19483): Launched 09:19:45.083793 run iperf3-srv_10.42.42.10(pid=19484): Launched 09:19:45.199166 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:19:45.405021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:45.715201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19485): Launched 09:19:46.049861 run iperf3-srv_10.42.42.10(pid=19486): Launched 09:19:46.184651 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:19:46.394100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:46.712383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19487): Launched 09:19:46.996393 run iperf3-srv_10.42.42.10(pid=19488): Launched 09:19:47.127903 tst iperf3m4.py:8: start network... 09:19:47.336159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:47.818731 run create_hlr_db(pid=19489): Launched 09:19:47.944177 bus /gobi_6: Setting Powered False 09:19:49.005142 run create_hlr_db(pid=19489): Terminated: ok {rc=0} 09:19:49.433595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19491): Launched 09:19:49.743051 run osmo-hlr_10.42.42.2(pid=19492): Launched 09:19:49.860797 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:50.527084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19494): Launched 09:19:50.830156 run osmo-stp_10.42.42.5(pid=19495): Launched 09:19:50.945056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:51.467619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19497): Launched 09:19:51.583366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:51.840450 run patchelf(pid=19498): Launched 09:19:52.008559 run osmo-stp_10.42.42.5(pid=19495): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19495)] 09:19:52.136325 run osmo-stp_10.42.42.5(pid=19495): stdout: | (launched: 2022-12-09_09:19:50.774117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:52.266123 run osmo-stp_10.42.42.5(pid=19495): stderr: | [0;m[38;5;43m20221209091950943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091950943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091950943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091950943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091950944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091950944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091950944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:52.395731 run osmo-stp_10.42.42.5(pid=19495): stdout: | (launched: 2022-12-09_09:19:50.774117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:52.519989 run osmo-stp_10.42.42.5(pid=19495): stderr: | [0;m[38;5;43m20221209091950943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209091950943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209091950943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209091950943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209091950944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209091950944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209091950944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:52.667274 run patchelf(pid=19498): Terminating (SIGINT) 09:19:52.836732 run patchelf(pid=19498): Terminated: ok {rc=0} 09:19:52.959066 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19495): Process ended prematurely: osmo-stp_10.42.42.5(pid=19495) [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19495)] [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 09:19:52.968696 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:19:52.996276 run osmo-hlr_10.42.42.2(pid=19492): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19492)] 09:19:53.043524 run osmo-hlr_10.42.42.2(pid=19492): stdout: | (launched: 2022-12-09_09:19:49.686026) 09:19:53.092771 run osmo-hlr_10.42.42.2(pid=19492): stderr: | [0;m[1;31m20221209091949863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209091949863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209091949863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209091949863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209091949863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209091949863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209091949876 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209091949887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209091949887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209091949887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:53.142162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19481): Terminating (SIGTERM) 09:19:53.181935 run iperf3-srv_10.42.42.10(pid=19482): Terminating (SIGTERM) 09:19:53.221554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19483): Terminating (SIGTERM) 09:19:53.260895 run iperf3-srv_10.42.42.10(pid=19484): Terminating (SIGTERM) 09:19:53.300121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19485): Terminating (SIGTERM) 09:19:53.339564 run iperf3-srv_10.42.42.10(pid=19486): Terminating (SIGTERM) 09:19:53.378900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19487): Terminating (SIGTERM) 09:19:53.418362 run iperf3-srv_10.42.42.10(pid=19488): Terminating (SIGTERM) 09:19:53.457603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19491): Terminating (SIGTERM) 09:19:53.497096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19494): Terminating (SIGTERM) 09:19:53.536523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19497): Terminating (SIGTERM) 09:19:53.576394 --- ParallelTerminationStrategy: PID 19481 died... 09:19:53.595387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19481): Terminated: ok {rc=0} 09:19:53.639355 --- ParallelTerminationStrategy: PID 19482 died... 09:19:53.657960 run iperf3-srv_10.42.42.10(pid=19482): Terminated {rc=256} 09:19:53.702064 --- ParallelTerminationStrategy: PID 19483 died... 09:19:53.720720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19483): Terminated: ok {rc=0} 09:19:53.764166 --- ParallelTerminationStrategy: PID 19484 died... 09:19:53.782867 run iperf3-srv_10.42.42.10(pid=19484): Terminated {rc=256} 09:19:53.826252 --- ParallelTerminationStrategy: PID 19485 died... 09:19:53.845037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19485): Terminated: ok {rc=0} 09:19:53.888522 --- ParallelTerminationStrategy: PID 19486 died... 09:19:53.907201 run iperf3-srv_10.42.42.10(pid=19486): Terminated {rc=256} 09:19:53.951232 --- ParallelTerminationStrategy: PID 19487 died... 09:19:53.969900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19487): Terminated: ok {rc=0} 09:19:54.013400 --- ParallelTerminationStrategy: PID 19488 died... 09:19:54.032293 run iperf3-srv_10.42.42.10(pid=19488): Terminated {rc=256} 09:19:54.075701 --- ParallelTerminationStrategy: PID 19491 died... 09:19:54.094459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19491): Terminated: ok {rc=0} 09:19:54.137851 --- ParallelTerminationStrategy: PID 19494 died... 09:19:54.156449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19494): Terminated: ok {rc=0} 09:19:54.199895 --- ParallelTerminationStrategy: PID 19497 died... 09:19:54.218516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19497): Terminated: ok {rc=0} 09:19:54.303837 bus /gobi_4: Setting Powered False 09:19:55.403405 bus /gobi_4: Setting Powered False 09:19:56.517477 bus /gobi_1: Setting Powered False 09:19:57.616025 bus /gobi_1: Setting Powered False 09:19:58.730988 bus /gobi_0: Setting Powered False 09:19:59.827606 bus /gobi_0: Setting Powered False 09:20:00.954877 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 09:20:02.071909 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.088223 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:20:02.150237 tst ping.py: using LAC 20472 09:20:02.295526 tst ping.py: using RAC 72 09:20:02.422602 tst ping.py: using CellId 20472 09:20:02.546831 tst ping.py: using BVCI 20473 09:20:02.662334 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.674251 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.685708 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.697966 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.709218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.720701 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.732526 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:02.744070 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:20:02.859457 tst ping.py:19: start network... 09:20:03.059422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:03.518784 run create_hlr_db(pid=19502): Launched 09:20:03.644009 bus /gobi_6: Setting Powered False 09:20:04.703696 run create_hlr_db(pid=19502): Terminated: ok {rc=0} 09:20:05.117699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19504): Launched 09:20:05.414459 run osmo-hlr_10.42.42.2(pid=19505): Launched 09:20:05.528000 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:06.041726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19507): Launched 09:20:06.338502 run osmo-stp_10.42.42.5(pid=19508): Launched 09:20:06.450868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:06.962987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19510): Launched 09:20:07.077777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:07.329669 run patchelf(pid=19511): Launched 09:20:07.493909 run osmo-stp_10.42.42.5(pid=19508): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19508)] 09:20:07.619484 run osmo-stp_10.42.42.5(pid=19508): stdout: | (launched: 2022-12-09_09:20:06.283530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:07.746641 run osmo-stp_10.42.42.5(pid=19508): stderr: | [0;m[38;5;43m20221209092006453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092006453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092006454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092006454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092006454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092006455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092006455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:07.874675 run osmo-stp_10.42.42.5(pid=19508): stdout: | (launched: 2022-12-09_09:20:06.283530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:07.996480 run osmo-stp_10.42.42.5(pid=19508): stderr: | [0;m[38;5;43m20221209092006453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092006453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092006454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092006454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092006454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092006455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092006455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:08.140500 run patchelf(pid=19511): Terminating (SIGINT) 09:20:08.306426 run patchelf(pid=19511): Terminated: ok {rc=0} 09:20:08.426016 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19508): Process ended prematurely: osmo-stp_10.42.42.5(pid=19508) [trial-2357↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19508)] [trial-2357↪gprs:trx-lms-limenet-micro↪ping.py:22] 09:20:08.434861 tst ping.py:22: Test FAILED (6.4 sec) 09:20:08.461240 run osmo-hlr_10.42.42.2(pid=19505): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19505)] 09:20:08.508592 run osmo-hlr_10.42.42.2(pid=19505): stdout: | (launched: 2022-12-09_09:20:05.359567) 09:20:08.557706 run osmo-hlr_10.42.42.2(pid=19505): stderr: | [0;m[1;31m20221209092005530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092005530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092005531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092005531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092005531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092005531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092005543 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092005552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092005552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092005552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:08.607429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19504): Terminating (SIGTERM) 09:20:08.646998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19507): Terminating (SIGTERM) 09:20:08.686521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19510): Terminating (SIGTERM) 09:20:08.726418 --- ParallelTerminationStrategy: PID 19504 died... 09:20:08.745482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19504): Terminated: ok {rc=0} 09:20:08.789214 --- ParallelTerminationStrategy: PID 19507 died... 09:20:08.807685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19507): Terminated: ok {rc=0} 09:20:08.851403 --- ParallelTerminationStrategy: PID 19510 died... 09:20:08.869912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19510): Terminated: ok {rc=0} 09:20:08.954878 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 09:20:10.042086 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.053559 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:20:10.100221 tst ping_idle_ping.py: using LAC 20473 09:20:10.218478 tst ping_idle_ping.py: using RAC 73 09:20:10.337542 tst ping_idle_ping.py: using CellId 20473 09:20:10.457411 tst ping_idle_ping.py: using BVCI 20474 09:20:10.565489 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.576344 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.587213 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.597968 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.608519 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.619200 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.630031 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:20:10.640692 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:20:10.758262 tst ping_idle_ping.py:24: start network... 09:20:10.957560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:11.421983 run create_hlr_db(pid=19512): Launched 09:20:11.545845 bus /gobi_6: Setting Powered False 09:20:12.605944 run create_hlr_db(pid=19512): Terminated: ok {rc=0} 09:20:13.041496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19514): Launched 09:20:13.359950 run osmo-hlr_10.42.42.2(pid=19515): Launched 09:20:13.481917 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:14.034649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19517): Launched 09:20:14.353417 run osmo-stp_10.42.42.5(pid=19518): Launched 09:20:14.474758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:15.025687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19520): Launched 09:20:15.147399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:15.417775 run patchelf(pid=19521): Launched 09:20:15.595528 run osmo-stp_10.42.42.5(pid=19518): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19518)] 09:20:15.730330 run osmo-stp_10.42.42.5(pid=19518): stdout: | (launched: 2022-12-09_09:20:14.294880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:15.868764 run osmo-stp_10.42.42.5(pid=19518): stderr: | [0;m[38;5;43m20221209092014484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092014484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092014484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092014484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:16.024493 run osmo-stp_10.42.42.5(pid=19518): stdout: | (launched: 2022-12-09_09:20:14.294880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:16.154047 run osmo-stp_10.42.42.5(pid=19518): stderr: | [0;m[38;5;43m20221209092014484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092014484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092014484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092014484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092014485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:16.304491 run patchelf(pid=19521): Terminating (SIGINT) 09:20:16.478031 run patchelf(pid=19521): Terminated: ok {rc=0} 09:20:16.604545 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19518): Process ended prematurely: osmo-stp_10.42.42.5(pid=19518) [trial-2357↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19518)] [trial-2357↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 09:20:16.615207 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:20:16.642732 run osmo-hlr_10.42.42.2(pid=19515): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19515)] 09:20:16.692237 run osmo-hlr_10.42.42.2(pid=19515): stdout: | (launched: 2022-12-09_09:20:13.301627) 09:20:16.742798 run osmo-hlr_10.42.42.2(pid=19515): stderr: | [0;m[1;31m20221209092013496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092013496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092013496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092013496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092013496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092013496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092013508 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092013516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092013517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092013517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:16.794369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19514): Terminating (SIGTERM) 09:20:16.837174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19517): Terminating (SIGTERM) 09:20:16.878985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19520): Terminating (SIGTERM) 09:20:16.923533 --- ParallelTerminationStrategy: PID 19514 died... 09:20:16.943479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19514): Terminated: ok {rc=0} 09:20:16.989904 --- ParallelTerminationStrategy: PID 19517 died... 09:20:17.009230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19517): Terminated: ok {rc=0} 09:20:17.055403 --- ParallelTerminationStrategy: PID 19520 died... 09:20:17.074646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19520): Terminated: ok {rc=0} 09:20:17.161377 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 09:20:18.476940 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:18.482737 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:20:18.515677 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:20:18.556561 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:20:18.646978 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:20:18.677338 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:20:18.716220 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:20:19.314829 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:20:19.364433 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.375798 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:20:19.421428 tst cs_paging_gprs_active.py: using LAC 20474 09:20:19.541714 tst cs_paging_gprs_active.py: using RAC 74 09:20:19.659784 tst cs_paging_gprs_active.py: using CellId 20474 09:20:19.777611 tst cs_paging_gprs_active.py: using BVCI 20475 09:20:19.887943 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.899258 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.910272 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.921466 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.932434 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.943552 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.954723 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.965693 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:19.976782 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:20:20.097453 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:20:20.218778 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:20:20.438079 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:20.763762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19525): Launched 09:20:21.045811 run iperf3-srv_10.42.42.10(pid=19526): Launched 09:20:21.168592 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:20:21.387586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:21.713053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19527): Launched 09:20:21.995946 run iperf3-srv_10.42.42.10(pid=19528): Launched 09:20:22.118541 tst cs_paging_gprs_active.py:38: start network... 09:20:22.336730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:22.838658 run create_hlr_db(pid=19529): Launched 09:20:22.965139 bus /gobi_6: Setting Powered False 09:20:24.029669 run create_hlr_db(pid=19529): Terminated: ok {rc=0} 09:20:24.462913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19531): Launched 09:20:24.788488 run osmo-hlr_10.42.42.2(pid=19532): Launched 09:20:24.912436 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:25.473076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19534): Launched 09:20:25.796377 run osmo-stp_10.42.42.5(pid=19535): Launched 09:20:25.920184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:26.481724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19537): Launched 09:20:26.605303 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:26.879400 run patchelf(pid=19538): Launched 09:20:27.060854 run osmo-stp_10.42.42.5(pid=19535): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19535)] 09:20:27.197645 run osmo-stp_10.42.42.5(pid=19535): stdout: | (launched: 2022-12-09_09:20:25.736868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:27.335999 run osmo-stp_10.42.42.5(pid=19535): stderr: | [0;m[38;5;43m20221209092025929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092025929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092025929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092025930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092025930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092025930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092025930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:27.474249 run osmo-stp_10.42.42.5(pid=19535): stdout: | (launched: 2022-12-09_09:20:25.736868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:27.607351 run osmo-stp_10.42.42.5(pid=19535): stderr: | [0;m[38;5;43m20221209092025929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092025929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092025929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092025930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092025930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092025930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092025930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:27.764427 run patchelf(pid=19538): Terminating (SIGINT) 09:20:27.946607 run patchelf(pid=19538): Terminated: ok {rc=0} 09:20:28.077767 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19535): Process ended prematurely: osmo-stp_10.42.42.5(pid=19535) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19535)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:20:28.087915 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:20:28.116905 run osmo-hlr_10.42.42.2(pid=19532): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19532)] 09:20:28.166995 run osmo-hlr_10.42.42.2(pid=19532): stdout: | (launched: 2022-12-09_09:20:24.728749) 09:20:28.218825 run osmo-hlr_10.42.42.2(pid=19532): stderr: | [0;m[1;31m20221209092024926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092024926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092024926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092024926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092024926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092024926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092024939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092024947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092024947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092024947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:28.271388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19525): Terminating (SIGTERM) 09:20:28.313150 run iperf3-srv_10.42.42.10(pid=19526): Terminating (SIGTERM) 09:20:28.354769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19527): Terminating (SIGTERM) 09:20:28.396520 run iperf3-srv_10.42.42.10(pid=19528): Terminating (SIGTERM) 09:20:28.438196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19531): Terminating (SIGTERM) 09:20:28.479997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19534): Terminating (SIGTERM) 09:20:28.521662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19537): Terminating (SIGTERM) 09:20:28.563591 --- ParallelTerminationStrategy: PID 19525 died... 09:20:28.583469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19525): Terminated: ok {rc=0} 09:20:28.629991 --- ParallelTerminationStrategy: PID 19526 died... 09:20:28.649338 run iperf3-srv_10.42.42.10(pid=19526): Terminated {rc=256} 09:20:28.695422 --- ParallelTerminationStrategy: PID 19527 died... 09:20:28.714844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19527): Terminated: ok {rc=0} 09:20:28.761174 --- ParallelTerminationStrategy: PID 19528 died... 09:20:28.780379 run iperf3-srv_10.42.42.10(pid=19528): Terminated {rc=256} 09:20:28.826782 --- ParallelTerminationStrategy: PID 19531 died... 09:20:28.846178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19531): Terminated: ok {rc=0} 09:20:28.892272 --- ParallelTerminationStrategy: PID 19534 died... 09:20:28.912021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19534): Terminated: ok {rc=0} 09:20:28.958430 --- ParallelTerminationStrategy: PID 19537 died... 09:20:28.977866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19537): Terminated: ok {rc=0} 09:20:29.066210 bus /gobi_0: Setting Powered False 09:20:30.165607 bus /gobi_0: Setting Powered False 09:20:31.288550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:20:32.440600 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:32.452626 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:20:32.500914 tst iperf3.py: using LAC 20475 09:20:32.625835 tst iperf3.py: using RAC 75 09:20:32.744788 tst iperf3.py: using CellId 20475 09:20:32.862340 tst iperf3.py: using BVCI 20476 09:20:32.972426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:32.983817 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:32.995025 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:33.006377 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:33.017442 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:33.028429 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:33.039633 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:33.050658 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:33.061920 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:20:33.179760 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:20:33.382753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:33.686188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19539): Launched 09:20:33.951909 run iperf3-srv_10.42.42.10(pid=19540): Launched 09:20:34.067424 tst iperf3.py:8: start network... 09:20:34.270412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:34.739887 run create_hlr_db(pid=19541): Launched 09:20:34.864897 bus /gobi_6: Setting Powered False 09:20:35.925328 run create_hlr_db(pid=19541): Terminated: ok {rc=0} 09:20:36.367251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19543): Launched 09:20:36.691923 run osmo-hlr_10.42.42.2(pid=19544): Launched 09:20:36.815513 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:37.372926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19546): Launched 09:20:37.695091 run osmo-stp_10.42.42.5(pid=19547): Launched 09:20:37.818024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:38.376496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19549): Launched 09:20:38.501062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:38.773916 run patchelf(pid=19550): Launched 09:20:38.953959 run osmo-stp_10.42.42.5(pid=19547): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19547)] 09:20:39.089887 run osmo-stp_10.42.42.5(pid=19547): stdout: | (launched: 2022-12-09_09:20:37.635873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:39.227326 run osmo-stp_10.42.42.5(pid=19547): stderr: | [0;m[38;5;43m20221209092037826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092037826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092037826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092037827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092037827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092037827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092037827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:39.365699 run osmo-stp_10.42.42.5(pid=19547): stdout: | (launched: 2022-12-09_09:20:37.635873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:39.497975 run osmo-stp_10.42.42.5(pid=19547): stderr: | [0;m[38;5;43m20221209092037826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092037826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092037826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092037827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092037827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092037827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092037827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:39.654599 run patchelf(pid=19550): Terminating (SIGINT) 09:20:39.835276 run patchelf(pid=19550): Terminated: ok {rc=0} 09:20:39.965699 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19547): Process ended prematurely: osmo-stp_10.42.42.5(pid=19547) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19547)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 09:20:39.975763 tst iperf3.py:8: Test FAILED (7.6 sec) 09:20:40.004707 run osmo-hlr_10.42.42.2(pid=19544): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19544)] 09:20:40.054533 run osmo-hlr_10.42.42.2(pid=19544): stdout: | (launched: 2022-12-09_09:20:36.632678) 09:20:40.106364 run osmo-hlr_10.42.42.2(pid=19544): stderr: | [0;m[1;31m20221209092036831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092036831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092036831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092036831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092036831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092036831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092036843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092036851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092036852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092036852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:40.158421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19539): Terminating (SIGTERM) 09:20:40.200414 run iperf3-srv_10.42.42.10(pid=19540): Terminating (SIGTERM) 09:20:40.242306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19543): Terminating (SIGTERM) 09:20:40.284169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19546): Terminating (SIGTERM) 09:20:40.325898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19549): Terminating (SIGTERM) 09:20:40.368088 --- ParallelTerminationStrategy: PID 19539 died... 09:20:40.388024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19539): Terminated: ok {rc=0} 09:20:40.435010 --- ParallelTerminationStrategy: PID 19540 died... 09:20:40.454385 run iperf3-srv_10.42.42.10(pid=19540): Terminated {rc=256} 09:20:40.500289 --- ParallelTerminationStrategy: PID 19543 died... 09:20:40.519645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19543): Terminated: ok {rc=0} 09:20:40.565871 --- ParallelTerminationStrategy: PID 19546 died... 09:20:40.585303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19546): Terminated: ok {rc=0} 09:20:40.631346 --- ParallelTerminationStrategy: PID 19549 died... 09:20:40.650771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19549): Terminated: ok {rc=0} 09:20:40.738662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:20:41.890041 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:41.903034 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:20:41.951487 tst iperf3m4.py: using LAC 20476 09:20:42.079785 tst iperf3m4.py: using RAC 76 09:20:42.200757 tst iperf3m4.py: using CellId 20476 09:20:42.328421 tst iperf3m4.py: using BVCI 20477 09:20:42.445886 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.457863 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.469646 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.481507 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.493554 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.505602 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.517475 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.529125 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:20:42.540830 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:20:42.669153 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:20:42.788203 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:20:42.905926 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:20:43.028224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:20:43.246666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:43.570778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19551): Launched 09:20:43.853598 run iperf3-srv_10.42.42.10(pid=19552): Launched 09:20:43.977318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:20:44.195941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:44.520781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19553): Launched 09:20:44.802195 run iperf3-srv_10.42.42.10(pid=19554): Launched 09:20:44.925457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:20:45.144148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:45.469462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19555): Launched 09:20:45.750521 run iperf3-srv_10.42.42.10(pid=19556): Launched 09:20:45.891893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:20:46.114738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:46.430419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19557): Launched 09:20:46.720548 run iperf3-srv_10.42.42.10(pid=19558): Launched 09:20:46.852447 tst iperf3m4.py:8: start network... 09:20:47.062609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:47.540005 run create_hlr_db(pid=19559): Launched 09:20:47.663932 bus /gobi_6: Setting Powered False 09:20:48.723738 run create_hlr_db(pid=19559): Terminated: ok {rc=0} 09:20:49.147738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19561): Launched 09:20:49.451529 run osmo-hlr_10.42.42.2(pid=19562): Launched 09:20:49.567368 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:50.095853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19564): Launched 09:20:50.399978 run osmo-stp_10.42.42.5(pid=19565): Launched 09:20:50.515109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:51.038158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19567): Launched 09:20:51.153933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:51.410232 run patchelf(pid=19568): Launched 09:20:51.578728 run osmo-stp_10.42.42.5(pid=19565): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19565)] 09:20:51.707342 run osmo-stp_10.42.42.5(pid=19565): stdout: | (launched: 2022-12-09_09:20:50.344278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:51.837724 run osmo-stp_10.42.42.5(pid=19565): stderr: | [0;m[38;5;43m20221209092050513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092050514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092050514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092050514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092050515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092050515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092050515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:51.968027 run osmo-stp_10.42.42.5(pid=19565): stdout: | (launched: 2022-12-09_09:20:50.344278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:52.092743 run osmo-stp_10.42.42.5(pid=19565): stderr: | [0;m[38;5;43m20221209092050513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092050514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092050514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092050514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092050515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092050515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092050515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:52.241065 run patchelf(pid=19568): Terminating (SIGINT) 09:20:52.411949 run patchelf(pid=19568): Terminated: ok {rc=0} 09:20:52.534636 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19565): Process ended prematurely: osmo-stp_10.42.42.5(pid=19565) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19565)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 09:20:52.544364 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:20:52.571860 run osmo-hlr_10.42.42.2(pid=19562): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19562)] 09:20:52.619458 run osmo-hlr_10.42.42.2(pid=19562): stdout: | (launched: 2022-12-09_09:20:49.395004) 09:20:52.668839 run osmo-hlr_10.42.42.2(pid=19562): stderr: | [0;m[1;31m20221209092049569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092049569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092049569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092049569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092049569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092049569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092049582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092049593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092049593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092049593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:52.718410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19551): Terminating (SIGTERM) 09:20:52.758269 run iperf3-srv_10.42.42.10(pid=19552): Terminating (SIGTERM) 09:20:52.798063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19553): Terminating (SIGTERM) 09:20:52.837985 run iperf3-srv_10.42.42.10(pid=19554): Terminating (SIGTERM) 09:20:52.877960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19555): Terminating (SIGTERM) 09:20:52.917857 run iperf3-srv_10.42.42.10(pid=19556): Terminating (SIGTERM) 09:20:52.957668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19557): Terminating (SIGTERM) 09:20:52.997615 run iperf3-srv_10.42.42.10(pid=19558): Terminating (SIGTERM) 09:20:53.037418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19561): Terminating (SIGTERM) 09:20:53.077345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19564): Terminating (SIGTERM) 09:20:53.117256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19567): Terminating (SIGTERM) 09:20:53.157226 --- ParallelTerminationStrategy: PID 19551 died... 09:20:53.176232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19551): Terminated: ok {rc=0} 09:20:53.220544 --- ParallelTerminationStrategy: PID 19552 died... 09:20:53.239291 run iperf3-srv_10.42.42.10(pid=19552): Terminated {rc=256} 09:20:53.282887 --- ParallelTerminationStrategy: PID 19553 died... 09:20:53.302030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19553): Terminated: ok {rc=0} 09:20:53.346228 --- ParallelTerminationStrategy: PID 19554 died... 09:20:53.365063 run iperf3-srv_10.42.42.10(pid=19554): Terminated {rc=256} 09:20:53.409227 --- ParallelTerminationStrategy: PID 19555 died... 09:20:53.427984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19555): Terminated: ok {rc=0} 09:20:53.472008 --- ParallelTerminationStrategy: PID 19556 died... 09:20:53.490946 run iperf3-srv_10.42.42.10(pid=19556): Terminated {rc=256} 09:20:53.534740 --- ParallelTerminationStrategy: PID 19557 died... 09:20:53.553571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19557): Terminated: ok {rc=0} 09:20:53.597891 --- ParallelTerminationStrategy: PID 19558 died... 09:20:53.616720 run iperf3-srv_10.42.42.10(pid=19558): Terminated {rc=256} 09:20:53.660623 --- ParallelTerminationStrategy: PID 19561 died... 09:20:53.679436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19561): Terminated: ok {rc=0} 09:20:53.723284 --- ParallelTerminationStrategy: PID 19564 died... 09:20:53.741920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19564): Terminated: ok {rc=0} 09:20:53.785636 --- ParallelTerminationStrategy: PID 19567 died... 09:20:53.804410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19567): Terminated: ok {rc=0} 09:20:53.887553 bus /gobi_4: Setting Powered False 09:20:54.985173 bus /gobi_4: Setting Powered False 09:20:56.099385 bus /gobi_1: Setting Powered False 09:20:57.200091 bus /gobi_1: Setting Powered False 09:20:58.313944 bus /gobi_0: Setting Powered False 09:20:59.412456 bus /gobi_0: Setting Powered False 09:21:00.529302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 09:21:01.634465 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:01.648646 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:21:01.701401 tst ping.py: using LAC 20477 09:21:01.831513 tst ping.py: using RAC 77 09:21:01.958206 tst ping.py: using CellId 20477 09:21:02.123740 tst ping.py: using BVCI 20478 09:21:02.242048 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:02.254836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:02.268235 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:02.279963 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:02.290993 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:02.301835 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:02.313092 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:02.324208 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:21:02.440704 tst ping.py:19: start network... 09:21:02.639062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:03.099219 run create_hlr_db(pid=19569): Launched 09:21:03.220637 bus /gobi_6: Setting Powered False 09:21:04.284314 run create_hlr_db(pid=19569): Terminated: ok {rc=0} 09:21:04.726353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19571): Launched 09:21:05.055100 run osmo-hlr_10.42.42.2(pid=19572): Launched 09:21:05.176149 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:05.728211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19574): Launched 09:21:06.047709 run osmo-stp_10.42.42.5(pid=19575): Launched 09:21:06.168372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:06.717681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19577): Launched 09:21:06.838900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:07.108341 run patchelf(pid=19578): Launched 09:21:07.285577 run osmo-stp_10.42.42.5(pid=19575): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19575)] 09:21:07.420354 run osmo-stp_10.42.42.5(pid=19575): stdout: | (launched: 2022-12-09_09:21:05.989570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:07.557092 run osmo-stp_10.42.42.5(pid=19575): stderr: | [0;m[38;5;43m20221209092106179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092106179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092106179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092106179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092106180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092106180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092106180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:07.694143 run osmo-stp_10.42.42.5(pid=19575): stdout: | (launched: 2022-12-09_09:21:05.989570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:07.825240 run osmo-stp_10.42.42.5(pid=19575): stderr: | [0;m[38;5;43m20221209092106179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092106179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092106179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092106179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092106180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092106180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092106180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:07.980580 run patchelf(pid=19578): Terminating (SIGINT) 09:21:08.159043 run patchelf(pid=19578): Terminated: ok {rc=0} 09:21:08.287503 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19575): Process ended prematurely: osmo-stp_10.42.42.5(pid=19575) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19575)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 09:21:08.297184 tst ping.py:22: Test FAILED (6.7 sec) 09:21:08.326155 run osmo-hlr_10.42.42.2(pid=19572): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19572)] 09:21:08.377113 run osmo-hlr_10.42.42.2(pid=19572): stdout: | (launched: 2022-12-09_09:21:04.996786) 09:21:08.429612 run osmo-hlr_10.42.42.2(pid=19572): stderr: | [0;m[1;31m20221209092105191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092105191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092105191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092105191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092105191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092105191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092105203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092105213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092105213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092105213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:08.482698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19571): Terminating (SIGTERM) 09:21:08.525244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19574): Terminating (SIGTERM) 09:21:08.567844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19577): Terminating (SIGTERM) 09:21:08.610716 --- ParallelTerminationStrategy: PID 19571 died... 09:21:08.630900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19571): Terminated: ok {rc=0} 09:21:08.678220 --- ParallelTerminationStrategy: PID 19574 died... 09:21:08.698026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19574): Terminated: ok {rc=0} 09:21:08.745091 --- ParallelTerminationStrategy: PID 19577 died... 09:21:08.765025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19577): Terminated: ok {rc=0} 09:21:08.854347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:21:09.943039 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:09.955954 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:21:10.006318 tst ping_idle_ping.py: using LAC 20478 09:21:10.132104 tst ping_idle_ping.py: using RAC 78 09:21:10.257244 tst ping_idle_ping.py: using CellId 20478 09:21:10.381958 tst ping_idle_ping.py: using BVCI 20479 09:21:10.497879 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:10.509724 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:10.521194 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:10.532911 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:10.544559 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:10.556116 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:10.567977 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:21:10.579621 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:21:10.699206 tst ping_idle_ping.py:24: start network... 09:21:10.913380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:11.410483 run create_hlr_db(pid=19579): Launched 09:21:11.533183 bus /gobi_6: Setting Powered False 09:21:12.596941 run create_hlr_db(pid=19579): Terminated: ok {rc=0} 09:21:13.026832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19581): Launched 09:21:13.327891 run osmo-hlr_10.42.42.2(pid=19582): Launched 09:21:13.441871 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:13.956815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19584): Launched 09:21:14.255277 run osmo-stp_10.42.42.5(pid=19585): Launched 09:21:14.371140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:14.901260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19587): Launched 09:21:15.014917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:15.267334 run patchelf(pid=19588): Launched 09:21:15.433189 run osmo-stp_10.42.42.5(pid=19585): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19585)] 09:21:15.559682 run osmo-stp_10.42.42.5(pid=19585): stdout: | (launched: 2022-12-09_09:21:14.200083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:15.687627 run osmo-stp_10.42.42.5(pid=19585): stderr: | [0;m[38;5;43m20221209092114367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092114367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092114367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092114368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092114368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092114368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092114368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:15.815501 run osmo-stp_10.42.42.5(pid=19585): stdout: | (launched: 2022-12-09_09:21:14.200083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:15.970068 run osmo-stp_10.42.42.5(pid=19585): stderr: | [0;m[38;5;43m20221209092114367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092114367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092114367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092114368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092114368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092114368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092114368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:16.131153 run patchelf(pid=19588): Terminating (SIGINT) 09:21:16.307246 run patchelf(pid=19588): Terminated: ok {rc=0} 09:21:16.432209 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19585): Process ended prematurely: osmo-stp_10.42.42.5(pid=19585) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19585)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 09:21:16.441798 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:21:16.469747 run osmo-hlr_10.42.42.2(pid=19582): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19582)] 09:21:16.519183 run osmo-hlr_10.42.42.2(pid=19582): stdout: | (launched: 2022-12-09_09:21:13.272604) 09:21:16.570370 run osmo-hlr_10.42.42.2(pid=19582): stderr: | [0;m[1;31m20221209092113447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092113447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092113447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092113447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092113447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092113447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092113459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092113468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092113468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092113468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:16.621809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19581): Terminating (SIGTERM) 09:21:16.662841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19584): Terminating (SIGTERM) 09:21:16.704432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19587): Terminating (SIGTERM) 09:21:16.747526 --- ParallelTerminationStrategy: PID 19581 died... 09:21:16.767165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19581): Terminated: ok {rc=0} 09:21:16.812578 --- ParallelTerminationStrategy: PID 19584 died... 09:21:16.832052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19584): Terminated: ok {rc=0} 09:21:16.877180 --- ParallelTerminationStrategy: PID 19587 died... 09:21:16.896733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19587): Terminated: ok {rc=0} 09:21:16.983962 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:21:18.293011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:18.299896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:21:18.333538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:21:18.374590 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:21:18.465414 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:21:18.496512 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:21:18.537864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:21:19.139076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:21:19.192354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.204106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:21:19.277967 tst cs_paging_gprs_active.py: using LAC 20479 09:21:19.401547 tst cs_paging_gprs_active.py: using RAC 79 09:21:19.521680 tst cs_paging_gprs_active.py: using CellId 20479 09:21:19.642796 tst cs_paging_gprs_active.py: using BVCI 20480 09:21:19.752861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.764064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.775176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.786354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.797437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.808431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.819531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.830506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:19.841712 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:21:19.962252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:21:20.083775 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:21:20.303817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:20.631471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19592): Launched 09:21:20.914603 run iperf3-srv_10.42.42.10(pid=19593): Launched 09:21:21.038481 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:21:21.258186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:21.585140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19594): Launched 09:21:21.867472 run iperf3-srv_10.42.42.10(pid=19595): Launched 09:21:21.992905 tst cs_paging_gprs_active.py:38: start network... 09:21:22.212486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:22.717551 run create_hlr_db(pid=19596): Launched 09:21:22.841749 bus /gobi_6: Setting Powered False 09:21:23.905857 run create_hlr_db(pid=19596): Terminated: ok {rc=0} 09:21:24.342286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19598): Launched 09:21:24.649385 run osmo-hlr_10.42.42.2(pid=19600): Launched 09:21:24.767287 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:25.294024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19602): Launched 09:21:25.598910 run osmo-stp_10.42.42.5(pid=19603): Launched 09:21:25.717392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:26.242512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19605): Launched 09:21:26.358639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:26.617790 run patchelf(pid=19606): Launched 09:21:26.786435 run osmo-stp_10.42.42.5(pid=19603): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19603)] 09:21:26.915239 run osmo-stp_10.42.42.5(pid=19603): stdout: | (launched: 2022-12-09_09:21:25.542707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:27.045998 run osmo-stp_10.42.42.5(pid=19603): stderr: | [0;m[38;5;43m20221209092125712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092125712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092125712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092125713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092125713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092125713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092125713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:27.176232 run osmo-stp_10.42.42.5(pid=19603): stdout: | (launched: 2022-12-09_09:21:25.542707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:27.301085 run osmo-stp_10.42.42.5(pid=19603): stderr: | [0;m[38;5;43m20221209092125712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092125712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092125712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092125713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092125713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092125713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092125713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:27.448882 run patchelf(pid=19606): Terminating (SIGINT) 09:21:27.619634 run patchelf(pid=19606): Terminated: ok {rc=0} 09:21:27.743102 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19603): Process ended prematurely: osmo-stp_10.42.42.5(pid=19603) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19603)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:21:27.752749 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:21:27.780045 run osmo-hlr_10.42.42.2(pid=19600): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19600)] 09:21:27.827716 run osmo-hlr_10.42.42.2(pid=19600): stdout: | (launched: 2022-12-09_09:21:24.592320) 09:21:27.877552 run osmo-hlr_10.42.42.2(pid=19600): stderr: | [0;m[1;31m20221209092124769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092124769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092124769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092124769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092124769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092124769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092124782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092124790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092124790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092124790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:27.927296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19592): Terminating (SIGTERM) 09:21:27.967055 run iperf3-srv_10.42.42.10(pid=19593): Terminating (SIGTERM) 09:21:28.006722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19594): Terminating (SIGTERM) 09:21:28.046368 run iperf3-srv_10.42.42.10(pid=19595): Terminating (SIGTERM) 09:21:28.085928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19598): Terminating (SIGTERM) 09:21:28.125773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19602): Terminating (SIGTERM) 09:21:28.165444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19605): Terminating (SIGTERM) 09:21:28.205292 --- ParallelTerminationStrategy: PID 19592 died... 09:21:28.224235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19592): Terminated: ok {rc=0} 09:21:28.268342 --- ParallelTerminationStrategy: PID 19593 died... 09:21:28.286727 run iperf3-srv_10.42.42.10(pid=19593): Terminated {rc=256} 09:21:28.330108 --- ParallelTerminationStrategy: PID 19594 died... 09:21:28.348425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19594): Terminated: ok {rc=0} 09:21:28.391839 --- ParallelTerminationStrategy: PID 19595 died... 09:21:28.410424 run iperf3-srv_10.42.42.10(pid=19595): Terminated {rc=256} 09:21:28.454469 --- ParallelTerminationStrategy: PID 19598 died... 09:21:28.473111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19598): Terminated: ok {rc=0} 09:21:28.517365 --- ParallelTerminationStrategy: PID 19602 died... 09:21:28.535812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19602): Terminated: ok {rc=0} 09:21:28.579041 --- ParallelTerminationStrategy: PID 19605 died... 09:21:28.597498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19605): Terminated: ok {rc=0} 09:21:28.680590 bus /gobi_0: Setting Powered False 09:21:29.777881 bus /gobi_0: Setting Powered False 09:21:30.910995 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:21:32.063426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.076456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:21:32.150880 tst iperf3.py: using LAC 20480 09:21:32.291751 tst iperf3.py: using RAC 80 09:21:32.418109 tst iperf3.py: using CellId 20480 09:21:32.544237 tst iperf3.py: using BVCI 20481 09:21:32.663201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.675081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.686773 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.699044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.710957 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.722843 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.735034 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.747185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:32.759820 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:21:32.876941 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:21:33.080870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:33.385968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19608): Launched 09:21:33.652145 run iperf3-srv_10.42.42.10(pid=19609): Launched 09:21:33.766293 tst iperf3.py:8: start network... 09:21:33.969730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:34.441668 run create_hlr_db(pid=19610): Launched 09:21:34.567669 bus /gobi_6: Setting Powered False 09:21:35.631507 run create_hlr_db(pid=19610): Terminated: ok {rc=0} 09:21:36.064804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19612): Launched 09:21:36.370577 run osmo-hlr_10.42.42.2(pid=19613): Launched 09:21:36.486794 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:37.017679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19615): Launched 09:21:37.319547 run osmo-stp_10.42.42.5(pid=19617): Launched 09:21:37.435285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:37.959045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19619): Launched 09:21:38.074705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:38.331678 run patchelf(pid=19620): Launched 09:21:38.499532 run osmo-stp_10.42.42.5(pid=19617): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19617)] 09:21:38.628342 run osmo-stp_10.42.42.5(pid=19617): stdout: | (launched: 2022-12-09_09:21:37.263909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:38.758309 run osmo-stp_10.42.42.5(pid=19617): stderr: | [0;m[38;5;43m20221209092137434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092137434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092137435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092137435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092137435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092137435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092137436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:38.888108 run osmo-stp_10.42.42.5(pid=19617): stdout: | (launched: 2022-12-09_09:21:37.263909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:39.012355 run osmo-stp_10.42.42.5(pid=19617): stderr: | [0;m[38;5;43m20221209092137434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092137434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092137435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092137435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092137435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092137435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092137436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:39.159467 run patchelf(pid=19620): Terminating (SIGINT) 09:21:39.329586 run patchelf(pid=19620): Terminated: ok {rc=0} 09:21:39.452551 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19617): Process ended prematurely: osmo-stp_10.42.42.5(pid=19617) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19617)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 09:21:39.462122 tst iperf3.py:8: Test FAILED (7.4 sec) 09:21:39.489134 run osmo-hlr_10.42.42.2(pid=19613): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19613)] 09:21:39.536194 run osmo-hlr_10.42.42.2(pid=19613): stdout: | (launched: 2022-12-09_09:21:36.313817) 09:21:39.585184 run osmo-hlr_10.42.42.2(pid=19613): stderr: | [0;m[1;31m20221209092136488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092136488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092136488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092136488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092136488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092136488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092136499 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092136508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092136509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092136509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:39.634604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19608): Terminating (SIGTERM) 09:21:39.674174 run iperf3-srv_10.42.42.10(pid=19609): Terminating (SIGTERM) 09:21:39.713515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19612): Terminating (SIGTERM) 09:21:39.752899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19615): Terminating (SIGTERM) 09:21:39.792369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19619): Terminating (SIGTERM) 09:21:39.832013 --- ParallelTerminationStrategy: PID 19608 died... 09:21:39.850923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19608): Terminated: ok {rc=0} 09:21:39.894609 --- ParallelTerminationStrategy: PID 19609 died... 09:21:39.913080 run iperf3-srv_10.42.42.10(pid=19609): Terminated {rc=256} 09:21:39.957140 --- ParallelTerminationStrategy: PID 19612 died... 09:21:39.975449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19612): Terminated: ok {rc=0} 09:21:40.019498 --- ParallelTerminationStrategy: PID 19615 died... 09:21:40.037886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19615): Terminated: ok {rc=0} 09:21:40.081255 --- ParallelTerminationStrategy: PID 19619 died... 09:21:40.099614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19619): Terminated: ok {rc=0} 09:21:40.184564 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:21:41.331332 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.343202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:21:41.415570 tst iperf3m4.py: using LAC 20481 09:21:41.541701 tst iperf3m4.py: using RAC 81 09:21:41.659608 tst iperf3m4.py: using CellId 20481 09:21:41.777789 tst iperf3m4.py: using BVCI 20482 09:21:41.889905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.901187 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.912295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.923469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.934599 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.945650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.956755 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.967803 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:21:41.978975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:21:42.097521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:21:42.219374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:21:42.340488 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:21:42.462448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:21:42.682771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:43.008736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19621): Launched 09:21:43.290785 run iperf3-srv_10.42.42.10(pid=19622): Launched 09:21:43.413850 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:21:43.632556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:43.958285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19623): Launched 09:21:44.240326 run iperf3-srv_10.42.42.10(pid=19624): Launched 09:21:44.362607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:21:44.581691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:44.908127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19625): Launched 09:21:45.191824 run iperf3-srv_10.42.42.10(pid=19626): Launched 09:21:45.313722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:21:45.532746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:21:45.866083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19627): Launched 09:21:46.151795 run iperf3-srv_10.42.42.10(pid=19628): Launched 09:21:46.283587 tst iperf3m4.py:8: start network... 09:21:46.494686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:47.002078 run create_hlr_db(pid=19629): Launched 09:21:47.163517 bus /gobi_6: Setting Powered False 09:21:48.224480 run create_hlr_db(pid=19629): Terminated: ok {rc=0} 09:21:48.668375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19631): Launched 09:21:48.992781 run osmo-hlr_10.42.42.2(pid=19632): Launched 09:21:49.117156 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:49.679767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19634): Launched 09:21:50.006210 run osmo-stp_10.42.42.5(pid=19635): Launched 09:21:50.133513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:50.695858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19637): Launched 09:21:50.819753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:51.094990 run patchelf(pid=19638): Launched 09:21:51.276558 run osmo-stp_10.42.42.5(pid=19635): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19635)] 09:21:51.413894 run osmo-stp_10.42.42.5(pid=19635): stdout: | (launched: 2022-12-09_09:21:49.945949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:51.552615 run osmo-stp_10.42.42.5(pid=19635): stderr: | [0;m[38;5;43m20221209092150135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092150135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092150135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092150136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092150136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092150136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092150136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:51.691357 run osmo-stp_10.42.42.5(pid=19635): stdout: | (launched: 2022-12-09_09:21:49.945949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:51.824357 run osmo-stp_10.42.42.5(pid=19635): stderr: | [0;m[38;5;43m20221209092150135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092150135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092150135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092150136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092150136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092150136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092150136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:51.982561 run patchelf(pid=19638): Terminating (SIGINT) 09:21:52.164255 run patchelf(pid=19638): Terminated: ok {rc=0} 09:21:52.295136 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19635): Process ended prematurely: osmo-stp_10.42.42.5(pid=19635) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19635)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:21:52.305442 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:21:52.334884 run osmo-hlr_10.42.42.2(pid=19632): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19632)] 09:21:52.385285 run osmo-hlr_10.42.42.2(pid=19632): stdout: | (launched: 2022-12-09_09:21:48.933314) 09:21:52.437329 run osmo-hlr_10.42.42.2(pid=19632): stderr: | [0;m[1;31m20221209092149129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092149130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092149130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092149130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092149130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092149130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092149142 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092149150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092149150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092149150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:52.489804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19621): Terminating (SIGTERM) 09:21:52.531887 run iperf3-srv_10.42.42.10(pid=19622): Terminating (SIGTERM) 09:21:52.573923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19623): Terminating (SIGTERM) 09:21:52.615908 run iperf3-srv_10.42.42.10(pid=19624): Terminating (SIGTERM) 09:21:52.658023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19625): Terminating (SIGTERM) 09:21:52.699919 run iperf3-srv_10.42.42.10(pid=19626): Terminating (SIGTERM) 09:21:52.741684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19627): Terminating (SIGTERM) 09:21:52.783547 run iperf3-srv_10.42.42.10(pid=19628): Terminating (SIGTERM) 09:21:52.825378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19631): Terminating (SIGTERM) 09:21:52.867295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19634): Terminating (SIGTERM) 09:21:52.909273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19637): Terminating (SIGTERM) 09:21:52.951794 --- ParallelTerminationStrategy: PID 19621 died... 09:21:52.971704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19621): Terminated: ok {rc=0} 09:21:53.018958 --- ParallelTerminationStrategy: PID 19622 died... 09:21:53.038809 run iperf3-srv_10.42.42.10(pid=19622): Terminated {rc=256} 09:21:53.085090 --- ParallelTerminationStrategy: PID 19623 died... 09:21:53.104720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19623): Terminated: ok {rc=0} 09:21:53.150928 --- ParallelTerminationStrategy: PID 19624 died... 09:21:53.170400 run iperf3-srv_10.42.42.10(pid=19624): Terminated {rc=256} 09:21:53.216520 --- ParallelTerminationStrategy: PID 19625 died... 09:21:53.235986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19625): Terminated: ok {rc=0} 09:21:53.282190 --- ParallelTerminationStrategy: PID 19626 died... 09:21:53.301649 run iperf3-srv_10.42.42.10(pid=19626): Terminated {rc=256} 09:21:53.347997 --- ParallelTerminationStrategy: PID 19627 died... 09:21:53.367622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19627): Terminated: ok {rc=0} 09:21:53.414648 --- ParallelTerminationStrategy: PID 19628 died... 09:21:53.434219 run iperf3-srv_10.42.42.10(pid=19628): Terminated {rc=256} 09:21:53.480261 --- ParallelTerminationStrategy: PID 19631 died... 09:21:53.499867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19631): Terminated: ok {rc=0} 09:21:53.546258 --- ParallelTerminationStrategy: PID 19634 died... 09:21:53.565840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19634): Terminated: ok {rc=0} 09:21:53.612151 --- ParallelTerminationStrategy: PID 19637 died... 09:21:53.631728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19637): Terminated: ok {rc=0} 09:21:53.720705 bus /gobi_4: Setting Powered False 09:21:54.820685 bus /gobi_4: Setting Powered False 09:21:55.937316 bus /gobi_1: Setting Powered False 09:21:57.035621 bus /gobi_1: Setting Powered False 09:21:58.153883 bus /gobi_0: Setting Powered False 09:21:59.252487 bus /gobi_0: Setting Powered False 09:22:00.369063 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:22:01.476147 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:01.491967 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:22:01.573232 tst ping.py: using LAC 20482 09:22:01.704631 tst ping.py: using RAC 82 09:22:01.866329 tst ping.py: using CellId 20482 09:22:01.984862 tst ping.py: using BVCI 20483 09:22:02.095696 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:02.108096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:02.121218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:02.134134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:02.146076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:02.158693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:02.171432 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:02.184595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:22:02.303962 tst ping.py:19: start network... 09:22:02.503579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:02.966801 run create_hlr_db(pid=19639): Launched 09:22:03.091200 bus /gobi_6: Setting Powered False 09:22:04.150506 run create_hlr_db(pid=19639): Terminated: ok {rc=0} 09:22:04.588598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19641): Launched 09:22:04.908600 run osmo-hlr_10.42.42.2(pid=19642): Launched 09:22:05.033741 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:05.586878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19644): Launched 09:22:05.906552 run osmo-stp_10.42.42.5(pid=19645): Launched 09:22:06.029091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:06.582585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19647): Launched 09:22:06.706148 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:06.976530 run patchelf(pid=19648): Launched 09:22:07.153740 run osmo-stp_10.42.42.5(pid=19645): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19645)] 09:22:07.288540 run osmo-stp_10.42.42.5(pid=19645): stdout: | (launched: 2022-12-09_09:22:05.848016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:07.424899 run osmo-stp_10.42.42.5(pid=19645): stderr: | [0;m[38;5;43m20221209092206037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092206037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092206038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092206038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092206039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092206039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092206039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:07.561709 run osmo-stp_10.42.42.5(pid=19645): stdout: | (launched: 2022-12-09_09:22:05.848016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:07.693189 run osmo-stp_10.42.42.5(pid=19645): stderr: | [0;m[38;5;43m20221209092206037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092206037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092206038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092206038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092206039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092206039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092206039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:07.847840 run patchelf(pid=19648): Terminating (SIGINT) 09:22:08.026594 run patchelf(pid=19648): Terminated: ok {rc=0} 09:22:08.154761 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19645): Process ended prematurely: osmo-stp_10.42.42.5(pid=19645) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19645)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 09:22:08.164350 tst ping.py:22: Test FAILED (6.7 sec) 09:22:08.192725 run osmo-hlr_10.42.42.2(pid=19642): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19642)] 09:22:08.243081 run osmo-hlr_10.42.42.2(pid=19642): stdout: | (launched: 2022-12-09_09:22:04.850069) 09:22:08.294704 run osmo-hlr_10.42.42.2(pid=19642): stderr: | [0;m[1;31m20221209092205048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092205048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092205048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092205048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092205048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092205048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092205060 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092205069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092205069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092205069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:08.346963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19641): Terminating (SIGTERM) 09:22:08.388818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19644): Terminating (SIGTERM) 09:22:08.430692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19647): Terminating (SIGTERM) 09:22:08.472760 --- ParallelTerminationStrategy: PID 19641 died... 09:22:08.492692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19641): Terminated: ok {rc=0} 09:22:08.538972 --- ParallelTerminationStrategy: PID 19644 died... 09:22:08.558387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19644): Terminated: ok {rc=0} 09:22:08.604583 --- ParallelTerminationStrategy: PID 19647 died... 09:22:08.624063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19647): Terminated: ok {rc=0} 09:22:08.711603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:22:09.799473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:09.812299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:22:09.883004 tst ping_idle_ping.py: using LAC 20483 09:22:10.010243 tst ping_idle_ping.py: using RAC 83 09:22:10.138799 tst ping_idle_ping.py: using CellId 20483 09:22:10.262269 tst ping_idle_ping.py: using BVCI 20484 09:22:10.378204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:10.389971 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:10.401494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:10.413313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:10.424907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:10.436591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:10.448433 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:22:10.460583 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:22:10.579573 tst ping_idle_ping.py:24: start network... 09:22:10.780920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:11.247799 run create_hlr_db(pid=19649): Launched 09:22:11.371192 bus /gobi_6: Setting Powered False 09:22:12.431531 run create_hlr_db(pid=19649): Terminated: ok {rc=0} 09:22:12.851092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19651): Launched 09:22:13.151476 run osmo-hlr_10.42.42.2(pid=19652): Launched 09:22:13.266309 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:13.785233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19654): Launched 09:22:14.085190 run osmo-stp_10.42.42.5(pid=19655): Launched 09:22:14.199127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:14.716472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19657): Launched 09:22:14.832157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:15.086908 run patchelf(pid=19658): Launched 09:22:15.254519 run osmo-stp_10.42.42.5(pid=19655): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19655)] 09:22:15.382055 run osmo-stp_10.42.42.5(pid=19655): stdout: | (launched: 2022-12-09_09:22:14.029561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:15.510801 run osmo-stp_10.42.42.5(pid=19655): stderr: | [0;m[38;5;43m20221209092214198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092214198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092214199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092214199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092214200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092214200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092214200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:15.639651 run osmo-stp_10.42.42.5(pid=19655): stdout: | (launched: 2022-12-09_09:22:14.029561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:15.763312 run osmo-stp_10.42.42.5(pid=19655): stderr: | [0;m[38;5;43m20221209092214198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092214198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092214199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092214199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092214200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092214200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092214200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:15.910736 run patchelf(pid=19658): Terminating (SIGINT) 09:22:16.082681 run patchelf(pid=19658): Terminated: ok {rc=0} 09:22:16.206258 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19655): Process ended prematurely: osmo-stp_10.42.42.5(pid=19655) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19655)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:22:16.215745 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:22:16.243614 run osmo-hlr_10.42.42.2(pid=19652): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19652)] 09:22:16.293518 run osmo-hlr_10.42.42.2(pid=19652): stdout: | (launched: 2022-12-09_09:22:13.096049) 09:22:16.344657 run osmo-hlr_10.42.42.2(pid=19652): stderr: | [0;m[1;31m20221209092213268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092213269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092213269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092213269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092213269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092213269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092213281 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092213289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092213290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092213290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:16.396189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19651): Terminating (SIGTERM) 09:22:16.437192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19654): Terminating (SIGTERM) 09:22:16.478734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19657): Terminating (SIGTERM) 09:22:16.520582 --- ParallelTerminationStrategy: PID 19651 died... 09:22:16.541306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19651): Terminated: ok {rc=0} 09:22:16.587062 --- ParallelTerminationStrategy: PID 19654 died... 09:22:16.606273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19654): Terminated: ok {rc=0} 09:22:16.651758 --- ParallelTerminationStrategy: PID 19657 died... 09:22:16.670886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19657): Terminated: ok {rc=0} 09:22:16.758325 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:22:18.074847 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:22:18.081709 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:22:18.113445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:22:18.153623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:22:18.243869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:22:18.274861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:22:18.315561 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:22:18.918855 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:22:18.970762 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:18.982330 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:22:19.050882 tst cs_paging_gprs_active.py: using LAC 20484 09:22:19.172726 tst cs_paging_gprs_active.py: using RAC 84 09:22:19.301373 tst cs_paging_gprs_active.py: using CellId 20484 09:22:19.430257 tst cs_paging_gprs_active.py: using BVCI 20485 09:22:19.550051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.562089 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.573689 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.585717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.597669 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.609440 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.621265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.632775 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:19.644667 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:22:19.764652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:22:19.886005 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:22:20.106820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:20.433889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19663): Launched 09:22:20.716762 run iperf3-srv_10.42.42.10(pid=19664): Launched 09:22:20.840515 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:22:21.062279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:21.391122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19665): Launched 09:22:21.674571 run iperf3-srv_10.42.42.10(pid=19666): Launched 09:22:21.798317 tst cs_paging_gprs_active.py:38: start network... 09:22:22.019349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:22.525129 run create_hlr_db(pid=19667): Launched 09:22:22.648668 bus /gobi_6: Setting Powered False 09:22:23.713758 run create_hlr_db(pid=19667): Terminated: ok {rc=0} 09:22:24.150598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19669): Launched 09:22:24.457655 run osmo-hlr_10.42.42.2(pid=19670): Launched 09:22:24.574886 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:25.100417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19672): Launched 09:22:25.406803 run osmo-stp_10.42.42.5(pid=19673): Launched 09:22:25.526705 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:26.052581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19675): Launched 09:22:26.168864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:26.433784 run patchelf(pid=19676): Launched 09:22:26.604658 run osmo-stp_10.42.42.5(pid=19673): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19673)] 09:22:26.734318 run osmo-stp_10.42.42.5(pid=19673): stdout: | (launched: 2022-12-09_09:22:25.350264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:26.865482 run osmo-stp_10.42.42.5(pid=19673): stderr: | [0;m[38;5;43m20221209092225518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092225518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092225518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092225519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092225519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092225519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092225519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:26.997490 run osmo-stp_10.42.42.5(pid=19673): stdout: | (launched: 2022-12-09_09:22:25.350264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:27.122977 run osmo-stp_10.42.42.5(pid=19673): stderr: | [0;m[38;5;43m20221209092225518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092225518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092225518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092225519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092225519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092225519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092225519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:27.271777 run patchelf(pid=19676): Terminating (SIGINT) 09:22:27.443642 run patchelf(pid=19676): Terminated: ok {rc=0} 09:22:27.567696 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19673): Process ended prematurely: osmo-stp_10.42.42.5(pid=19673) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19673)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:22:27.577468 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:22:27.604821 run osmo-hlr_10.42.42.2(pid=19670): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19670)] 09:22:27.652689 run osmo-hlr_10.42.42.2(pid=19670): stdout: | (launched: 2022-12-09_09:22:24.400514) 09:22:27.702516 run osmo-hlr_10.42.42.2(pid=19670): stderr: | [0;m[1;31m20221209092224576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092224576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092224576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092224576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092224576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092224576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092224588 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092224596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092224597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092224597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:27.752513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19663): Terminating (SIGTERM) 09:22:27.792545 run iperf3-srv_10.42.42.10(pid=19664): Terminating (SIGTERM) 09:22:27.832422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19665): Terminating (SIGTERM) 09:22:27.872401 run iperf3-srv_10.42.42.10(pid=19666): Terminating (SIGTERM) 09:22:27.912229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19669): Terminating (SIGTERM) 09:22:27.952210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19672): Terminating (SIGTERM) 09:22:27.992304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19675): Terminating (SIGTERM) 09:22:28.032687 --- ParallelTerminationStrategy: PID 19663 died... 09:22:28.051940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19663): Terminated: ok {rc=0} 09:22:28.096358 --- ParallelTerminationStrategy: PID 19664 died... 09:22:28.115219 run iperf3-srv_10.42.42.10(pid=19664): Terminated {rc=256} 09:22:28.159304 --- ParallelTerminationStrategy: PID 19665 died... 09:22:28.178001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19665): Terminated: ok {rc=0} 09:22:28.221913 --- ParallelTerminationStrategy: PID 19666 died... 09:22:28.240729 run iperf3-srv_10.42.42.10(pid=19666): Terminated {rc=256} 09:22:28.285225 --- ParallelTerminationStrategy: PID 19669 died... 09:22:28.303843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19669): Terminated: ok {rc=0} 09:22:28.347860 --- ParallelTerminationStrategy: PID 19672 died... 09:22:28.366794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19672): Terminated: ok {rc=0} 09:22:28.410718 --- ParallelTerminationStrategy: PID 19675 died... 09:22:28.429901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19675): Terminated: ok {rc=0} 09:22:28.516194 bus /gobi_0: Setting Powered False 09:22:29.616878 bus /gobi_0: Setting Powered False 09:22:30.733846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:22:31.882874 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:31.895741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:22:31.964674 tst iperf3.py: using LAC 20485 09:22:32.096726 tst iperf3.py: using RAC 85 09:22:32.236744 tst iperf3.py: using CellId 20485 09:22:32.363797 tst iperf3.py: using BVCI 20486 09:22:32.482475 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.494688 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.506482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.518606 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.531241 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.543239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.555740 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.567715 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:32.579984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:22:32.698427 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:22:32.918346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:33.245159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19677): Launched 09:22:33.527236 run iperf3-srv_10.42.42.10(pid=19678): Launched 09:22:33.648887 tst iperf3.py:8: start network... 09:22:33.868210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:34.374317 run create_hlr_db(pid=19679): Launched 09:22:34.499589 bus /gobi_6: Setting Powered False 09:22:35.563530 run create_hlr_db(pid=19679): Terminated: ok {rc=0} 09:22:36.017822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19686): Launched 09:22:36.344586 run osmo-hlr_10.42.42.2(pid=19687): Launched 09:22:36.470021 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:37.033330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19689): Launched 09:22:37.360476 run osmo-stp_10.42.42.5(pid=19690): Launched 09:22:37.486687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:38.049776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19692): Launched 09:22:38.173727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:38.449089 run patchelf(pid=19693): Launched 09:22:38.629739 run osmo-stp_10.42.42.5(pid=19690): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19690)] 09:22:38.767299 run osmo-stp_10.42.42.5(pid=19690): stdout: | (launched: 2022-12-09_09:22:37.300284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:38.906767 run osmo-stp_10.42.42.5(pid=19690): stderr: | [0;m[38;5;43m20221209092237491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092237491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092237491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092237492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092237492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092237492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092237492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:39.047438 run osmo-stp_10.42.42.5(pid=19690): stdout: | (launched: 2022-12-09_09:22:37.300284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:39.181392 run osmo-stp_10.42.42.5(pid=19690): stderr: | [0;m[38;5;43m20221209092237491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092237491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092237491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092237492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092237492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092237492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092237492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:39.339862 run patchelf(pid=19693): Terminating (SIGINT) 09:22:39.522071 run patchelf(pid=19693): Terminated: ok {rc=0} 09:22:39.653447 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19690): Process ended prematurely: osmo-stp_10.42.42.5(pid=19690) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19690)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 09:22:39.663588 tst iperf3.py:8: Test FAILED (7.8 sec) 09:22:39.692732 run osmo-hlr_10.42.42.2(pid=19687): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19687)] 09:22:39.743031 run osmo-hlr_10.42.42.2(pid=19687): stdout: | (launched: 2022-12-09_09:22:36.285287) 09:22:39.795157 run osmo-hlr_10.42.42.2(pid=19687): stderr: | [0;m[1;31m20221209092236481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092236481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092236482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092236482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092236482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092236482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092236494 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092236502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092236503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092236503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:39.847776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19677): Terminating (SIGTERM) 09:22:39.889939 run iperf3-srv_10.42.42.10(pid=19678): Terminating (SIGTERM) 09:22:39.932526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19686): Terminating (SIGTERM) 09:22:39.975150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19689): Terminating (SIGTERM) 09:22:40.017434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19692): Terminating (SIGTERM) 09:22:40.059767 --- ParallelTerminationStrategy: PID 19677 died... 09:22:40.079762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19677): Terminated: ok {rc=0} 09:22:40.126574 --- ParallelTerminationStrategy: PID 19678 died... 09:22:40.146014 run iperf3-srv_10.42.42.10(pid=19678): Terminated {rc=256} 09:22:40.192242 --- ParallelTerminationStrategy: PID 19686 died... 09:22:40.211840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19686): Terminated: ok {rc=0} 09:22:40.258243 --- ParallelTerminationStrategy: PID 19689 died... 09:22:40.277765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19689): Terminated: ok {rc=0} 09:22:40.324136 --- ParallelTerminationStrategy: PID 19692 died... 09:22:40.343800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19692): Terminated: ok {rc=0} 09:22:40.431827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:22:41.581645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:41.594401 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:22:41.665053 tst iperf3m4.py: using LAC 20486 09:22:41.786314 tst iperf3m4.py: using RAC 86 09:22:41.909493 tst iperf3m4.py: using CellId 20486 09:22:42.034595 tst iperf3m4.py: using BVCI 20487 09:22:42.148594 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.160140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.171474 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.183289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.194931 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.206506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.218281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.229893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:22:42.241667 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:22:42.363255 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:22:42.484213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:22:42.604143 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:22:42.725203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:22:42.946220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:43.275180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19694): Launched 09:22:43.560210 run iperf3-srv_10.42.42.10(pid=19695): Launched 09:22:43.682985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:22:43.903160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:44.232584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19696): Launched 09:22:44.517323 run iperf3-srv_10.42.42.10(pid=19697): Launched 09:22:44.639487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:22:44.859030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:45.188275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19698): Launched 09:22:45.473531 run iperf3-srv_10.42.42.10(pid=19699): Launched 09:22:45.595604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:22:45.815927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:22:46.173707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19700): Launched 09:22:46.465094 run iperf3-srv_10.42.42.10(pid=19701): Launched 09:22:46.595010 tst iperf3m4.py:8: start network... 09:22:46.820076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:47.338717 run create_hlr_db(pid=19702): Launched 09:22:47.464943 bus /gobi_6: Setting Powered False 09:22:48.529183 run create_hlr_db(pid=19702): Terminated: ok {rc=0} 09:22:48.964716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19704): Launched 09:22:49.272320 run osmo-hlr_10.42.42.2(pid=19705): Launched 09:22:49.390273 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:49.931546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19707): Launched 09:22:50.237224 run osmo-stp_10.42.42.5(pid=19708): Launched 09:22:50.354042 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:22:50.879487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19710): Launched 09:22:50.995971 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:22:51.256210 run patchelf(pid=19711): Launched 09:22:51.425173 run osmo-stp_10.42.42.5(pid=19708): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19708)] 09:22:51.553522 run osmo-stp_10.42.42.5(pid=19708): stdout: | (launched: 2022-12-09_09:22:50.180624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:51.683669 run osmo-stp_10.42.42.5(pid=19708): stderr: | [0;m[38;5;43m20221209092250350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092250350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092250351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092250351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092250351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092250352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092250352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:51.813779 run osmo-stp_10.42.42.5(pid=19708): stdout: | (launched: 2022-12-09_09:22:50.180624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:51.938448 run osmo-stp_10.42.42.5(pid=19708): stderr: | [0;m[38;5;43m20221209092250350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092250350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092250351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092250351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092250351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092250352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092250352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:52.086305 run patchelf(pid=19711): Terminating (SIGINT) 09:22:52.256811 run patchelf(pid=19711): Terminated: ok {rc=0} 09:22:52.379605 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19708): Process ended prematurely: osmo-stp_10.42.42.5(pid=19708) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19708)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:22:52.389259 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:22:52.416709 run osmo-hlr_10.42.42.2(pid=19705): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19705)] 09:22:52.464442 run osmo-hlr_10.42.42.2(pid=19705): stdout: | (launched: 2022-12-09_09:22:49.215342) 09:22:52.513704 run osmo-hlr_10.42.42.2(pid=19705): stderr: | [0;m[1;31m20221209092249389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092249389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092249389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092249389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092249389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092249389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092249402 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092249410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092249410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092249410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:52.563512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19694): Terminating (SIGTERM) 09:22:52.603449 run iperf3-srv_10.42.42.10(pid=19695): Terminating (SIGTERM) 09:22:52.643177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19696): Terminating (SIGTERM) 09:22:52.683026 run iperf3-srv_10.42.42.10(pid=19697): Terminating (SIGTERM) 09:22:52.722605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19698): Terminating (SIGTERM) 09:22:52.762318 run iperf3-srv_10.42.42.10(pid=19699): Terminating (SIGTERM) 09:22:52.801909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19700): Terminating (SIGTERM) 09:22:52.841672 run iperf3-srv_10.42.42.10(pid=19701): Terminating (SIGTERM) 09:22:52.881265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19704): Terminating (SIGTERM) 09:22:52.921360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19707): Terminating (SIGTERM) 09:22:52.961087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19710): Terminating (SIGTERM) 09:22:53.001001 --- ParallelTerminationStrategy: PID 19694 died... 09:22:53.020192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19694): Terminated: ok {rc=0} 09:22:53.064002 --- ParallelTerminationStrategy: PID 19695 died... 09:22:53.082532 run iperf3-srv_10.42.42.10(pid=19695): Terminated {rc=256} 09:22:53.126516 --- ParallelTerminationStrategy: PID 19696 died... 09:22:53.145077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19696): Terminated: ok {rc=0} 09:22:53.188495 --- ParallelTerminationStrategy: PID 19697 died... 09:22:53.206958 run iperf3-srv_10.42.42.10(pid=19697): Terminated {rc=256} 09:22:53.250457 --- ParallelTerminationStrategy: PID 19698 died... 09:22:53.268780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19698): Terminated: ok {rc=0} 09:22:53.312355 --- ParallelTerminationStrategy: PID 19699 died... 09:22:53.330990 run iperf3-srv_10.42.42.10(pid=19699): Terminated {rc=256} 09:22:53.374503 --- ParallelTerminationStrategy: PID 19700 died... 09:22:53.393264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19700): Terminated: ok {rc=0} 09:22:53.436865 --- ParallelTerminationStrategy: PID 19701 died... 09:22:53.455734 run iperf3-srv_10.42.42.10(pid=19701): Terminated {rc=256} 09:22:53.499354 --- ParallelTerminationStrategy: PID 19704 died... 09:22:53.518049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19704): Terminated: ok {rc=0} 09:22:53.561649 --- ParallelTerminationStrategy: PID 19707 died... 09:22:53.580240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19707): Terminated: ok {rc=0} 09:22:53.623811 --- ParallelTerminationStrategy: PID 19710 died... 09:22:53.642416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19710): Terminated: ok {rc=0} 09:22:53.727933 bus /gobi_4: Setting Powered False 09:22:54.829172 bus /gobi_4: Setting Powered False 09:22:55.945128 bus /gobi_1: Setting Powered False 09:22:57.047268 bus /gobi_1: Setting Powered False 09:22:58.163770 bus /gobi_0: Setting Powered False 09:22:59.263160 bus /gobi_0: Setting Powered False 09:23:00.378370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:23:01.481405 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:01.494853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:23:01.572230 tst ping.py: using LAC 20487 09:23:01.768281 tst ping.py: using RAC 87 09:23:01.915244 tst ping.py: using CellId 20487 09:23:02.067759 tst ping.py: using BVCI 20488 09:23:02.211616 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:02.224601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:02.237006 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:02.249027 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:02.260661 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:02.272883 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:02.285806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:02.302525 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:23:02.437382 tst ping.py:19: start network... 09:23:02.658474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:03.164449 run create_hlr_db(pid=19789): Launched 09:23:03.336772 bus /gobi_6: Setting Powered False 09:23:04.400868 run create_hlr_db(pid=19789): Terminated: ok {rc=0} 09:23:04.869314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19992): Launched 09:23:05.221689 run osmo-hlr_10.42.42.2(pid=19993): Launched 09:23:05.467298 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:06.125689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Launched 09:23:06.458999 run osmo-stp_10.42.42.5(pid=19998): Launched 09:23:06.698960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:07.371486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20000): Launched 09:23:07.505373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:07.784119 run patchelf(pid=20001): Launched 09:23:07.978094 run osmo-stp_10.42.42.5(pid=19998): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19998)] 09:23:08.117046 run osmo-stp_10.42.42.5(pid=19998): stdout: | (launched: 2022-12-09_09:23:06.398572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:08.257282 run osmo-stp_10.42.42.5(pid=19998): stderr: | [0;m[38;5;43m20221209092306722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092306722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092306722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092306723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092306723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092306723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092306723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:08.397413 run osmo-stp_10.42.42.5(pid=19998): stdout: | (launched: 2022-12-09_09:23:06.398572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:08.532380 run osmo-stp_10.42.42.5(pid=19998): stderr: | [0;m[38;5;43m20221209092306722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092306722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092306722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092306723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092306723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092306723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092306723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:08.692571 run patchelf(pid=20001): Terminating (SIGINT) 09:23:08.876533 run patchelf(pid=20001): Terminated: ok {rc=0} 09:23:09.010229 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19998): Process ended prematurely: osmo-stp_10.42.42.5(pid=19998) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19998)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 09:23:09.021197 tst ping.py:22: Test FAILED (7.5 sec) 09:23:09.053042 run osmo-hlr_10.42.42.2(pid=19993): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19993)] 09:23:09.105725 run osmo-hlr_10.42.42.2(pid=19993): stdout: | (launched: 2022-12-09_09:23:05.155336) 09:23:09.160028 run osmo-hlr_10.42.42.2(pid=19993): stderr: | [0;m[1;31m20221209092305485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092305485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092305485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092305485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092305485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092305485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092305510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092305527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092305527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092305527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:09.215346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19992): Terminating (SIGTERM) 09:23:09.259908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Terminating (SIGTERM) 09:23:09.306377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20000): Terminating (SIGTERM) 09:23:09.353329 --- ParallelTerminationStrategy: PID 19992 died... 09:23:09.374352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19992): Terminated: ok {rc=0} 09:23:09.425216 --- ParallelTerminationStrategy: PID 19996 died... 09:23:09.445746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19996): Terminated: ok {rc=0} 09:23:09.495637 --- ParallelTerminationStrategy: PID 20000 died... 09:23:09.516328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20000): Terminated: ok {rc=0} 09:23:09.609233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:23:10.702466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:10.717824 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:23:10.794959 tst ping_idle_ping.py: using LAC 20488 09:23:10.923986 tst ping_idle_ping.py: using RAC 88 09:23:11.056235 tst ping_idle_ping.py: using CellId 20488 09:23:11.187097 tst ping_idle_ping.py: using BVCI 20489 09:23:11.309709 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:11.322980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:11.336766 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:11.350724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:11.364426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:11.378330 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:11.391131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:23:11.405678 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:23:11.532354 tst ping_idle_ping.py:24: start network... 09:23:11.758250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:12.274932 run create_hlr_db(pid=20002): Launched 09:23:12.441072 bus /gobi_6: Setting Powered False 09:23:13.506751 run create_hlr_db(pid=20002): Terminated: ok {rc=0} 09:23:13.967762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20004): Launched 09:23:14.309047 run osmo-hlr_10.42.42.2(pid=20005): Launched 09:23:14.556755 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:15.227968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20007): Launched 09:23:15.568650 run osmo-stp_10.42.42.5(pid=20008): Launched 09:23:15.816496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:16.606753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20010): Launched 09:23:16.746574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:17.005867 run patchelf(pid=20011): Launched 09:23:17.188756 run osmo-stp_10.42.42.5(pid=20008): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20008)] 09:23:17.319084 run osmo-stp_10.42.42.5(pid=20008): stdout: | (launched: 2022-12-09_09:23:15.508074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:17.450279 run osmo-stp_10.42.42.5(pid=20008): stderr: | [0;m[38;5;43m20221209092315799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092315799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092315799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092315800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092315800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092315800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092315800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:17.582399 run osmo-stp_10.42.42.5(pid=20008): stdout: | (launched: 2022-12-09_09:23:15.508074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:17.708337 run osmo-stp_10.42.42.5(pid=20008): stderr: | [0;m[38;5;43m20221209092315799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092315799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092315799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092315800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092315800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092315800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092315800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:17.857630 run patchelf(pid=20011): Terminating (SIGINT) 09:23:18.029409 run patchelf(pid=20011): Terminated: ok {rc=0} 09:23:18.152763 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20008): Process ended prematurely: osmo-stp_10.42.42.5(pid=20008) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20008)] [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:23:18.162399 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 09:23:18.190177 run osmo-hlr_10.42.42.2(pid=20005): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20005)] 09:23:18.239064 run osmo-hlr_10.42.42.2(pid=20005): stdout: | (launched: 2022-12-09_09:23:14.249350) 09:23:18.289591 run osmo-hlr_10.42.42.2(pid=20005): stderr: | [0;m[1;31m20221209092314552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092314557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092314557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092314557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092314557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092314557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092314571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092314586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092314586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092314586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:18.340237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20004): Terminating (SIGTERM) 09:23:18.381804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20007): Terminating (SIGTERM) 09:23:18.424310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20010): Terminating (SIGTERM) 09:23:18.466140 --- ParallelTerminationStrategy: PID 20004 died... 09:23:18.485539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20004): Terminated: ok {rc=0} 09:23:18.531880 --- ParallelTerminationStrategy: PID 20007 died... 09:23:18.551140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20007): Terminated: ok {rc=0} 09:23:18.595750 --- ParallelTerminationStrategy: PID 20010 died... 09:23:18.614973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20010): Terminated: ok {rc=0} 09:23:18.701106 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:23:20.018556 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:20.026576 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:23:20.062458 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:23:20.101796 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:23:20.158257 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:23:20.191389 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:23:20.231830 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:23:20.791710 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:23:20.798768 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:20.812070 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:23:20.890981 tst switch_tch_pdch.py: using LAC 20489 09:23:21.020684 tst switch_tch_pdch.py: using RAC 89 09:23:21.147745 tst switch_tch_pdch.py: using CellId 20489 09:23:21.276920 tst switch_tch_pdch.py: using BVCI 20490 09:23:21.398259 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:21.411360 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:21.426715 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:21.440638 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:21.453952 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:21.468147 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:21.483331 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:23:21.497356 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:23:21.625314 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:23:21.753346 tst switch_tch_pdch.py:51: start network... 09:23:21.978352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:22.493664 run create_hlr_db(pid=20015): Launched 09:23:22.659057 bus /gobi_6: Setting Powered False 09:23:23.724358 run create_hlr_db(pid=20015): Terminated: ok {rc=0} 09:23:24.188054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20017): Launched 09:23:24.531841 run osmo-hlr_10.42.42.2(pid=20018): Launched 09:23:24.786315 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:25.456284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20020): Launched 09:23:25.799399 run osmo-stp_10.42.42.5(pid=20021): Launched 09:23:26.050048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:26.670517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20023): Launched 09:23:26.786072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:27.039113 run patchelf(pid=20024): Launched 09:23:27.204761 run osmo-stp_10.42.42.5(pid=20021): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20021)] 09:23:27.331173 run osmo-stp_10.42.42.5(pid=20021): stdout: | (launched: 2022-12-09_09:23:25.737860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:27.459758 run osmo-stp_10.42.42.5(pid=20021): stderr: | [0;m[38;5;43m20221209092326039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092326039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092326040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092326040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092326040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092326041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092326041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:27.587991 run osmo-stp_10.42.42.5(pid=20021): stdout: | (launched: 2022-12-09_09:23:25.737860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:27.710450 run osmo-stp_10.42.42.5(pid=20021): stderr: | [0;m[38;5;43m20221209092326039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092326039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092326040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092326040 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092326040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092326041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092326041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:27.855312 run patchelf(pid=20024): Terminating (SIGINT) 09:23:28.023009 run patchelf(pid=20024): Terminated: ok {rc=0} 09:23:28.143894 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20021): Process ended prematurely: osmo-stp_10.42.42.5(pid=20021) [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20021)] [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:23:28.152935 tst switch_tch_pdch.py:54: Test FAILED (7.3 sec) 09:23:28.179654 run osmo-hlr_10.42.42.2(pid=20018): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20018)] 09:23:28.227180 run osmo-hlr_10.42.42.2(pid=20018): stdout: | (launched: 2022-12-09_09:23:24.471655) 09:23:28.276343 run osmo-hlr_10.42.42.2(pid=20018): stderr: | [0;m[1;31m20221209092324782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092324782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092324782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092324782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092324782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092324782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092324795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092324808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092324808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092324808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:28.325831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20017): Terminating (SIGTERM) 09:23:28.365294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20020): Terminating (SIGTERM) 09:23:28.404913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20023): Terminating (SIGTERM) 09:23:28.444672 --- ParallelTerminationStrategy: PID 20017 died... 09:23:28.463753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20017): Terminated: ok {rc=0} 09:23:28.507592 --- ParallelTerminationStrategy: PID 20020 died... 09:23:28.526274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20020): Terminated: ok {rc=0} 09:23:28.569758 --- ParallelTerminationStrategy: PID 20023 died... 09:23:28.588320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20023): Terminated: ok {rc=0} 09:23:28.673165 bus /gobi_0: Setting Powered False 09:23:29.773112 bus /gobi_0: Setting Powered False 09:23:30.905539 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:23:32.180513 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:32.186995 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:23:32.218970 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:23:32.255006 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:23:32.309864 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:23:32.339789 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:23:32.374506 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:23:32.932512 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:23:32.937593 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:32.948769 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:23:33.015479 tst switch_tch_pdch.py: using LAC 20490 09:23:33.132519 tst switch_tch_pdch.py: using RAC 90 09:23:33.249385 tst switch_tch_pdch.py: using CellId 20490 09:23:33.374500 tst switch_tch_pdch.py: using BVCI 20491 09:23:33.486023 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:33.497478 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:33.508406 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:33.519506 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:33.530422 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:33.541520 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:33.552660 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:23:33.563680 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:23:33.683731 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:23:33.803426 tst switch_tch_pdch.py:51: start network... 09:23:34.002676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:34.439094 run create_hlr_db(pid=20028): Launched 09:23:34.564353 bus /gobi_6: Setting Powered False 09:23:35.628001 run create_hlr_db(pid=20028): Terminated: ok {rc=0} 09:23:36.033019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20030): Launched 09:23:36.332882 run osmo-hlr_10.42.42.2(pid=20031): Launched 09:23:36.447644 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:36.950972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20033): Launched 09:23:37.250267 run osmo-stp_10.42.42.5(pid=20034): Launched 09:23:37.363692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:23:37.854763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20036): Launched 09:23:37.968622 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:23:38.222322 run patchelf(pid=20037): Launched 09:23:38.390213 run osmo-stp_10.42.42.5(pid=20034): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20034)] 09:23:38.516641 run osmo-stp_10.42.42.5(pid=20034): stdout: | (launched: 2022-12-09_09:23:37.195010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:38.644873 run osmo-stp_10.42.42.5(pid=20034): stderr: | [0;m[38;5;43m20221209092337364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092337364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092337364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092337365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092337365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092337365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092337365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:38.772907 run osmo-stp_10.42.42.5(pid=20034): stdout: | (launched: 2022-12-09_09:23:37.195010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:38.895649 run osmo-stp_10.42.42.5(pid=20034): stderr: | [0;m[38;5;43m20221209092337364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092337364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092337364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092337365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092337365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092337365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092337365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:39.040894 run patchelf(pid=20037): Terminating (SIGINT) 09:23:39.207943 run patchelf(pid=20037): Terminated: ok {rc=0} 09:23:39.328336 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20034): Process ended prematurely: osmo-stp_10.42.42.5(pid=20034) [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20034)] [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:23:39.337304 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 09:23:39.363936 run osmo-hlr_10.42.42.2(pid=20031): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20031)] 09:23:39.411218 run osmo-hlr_10.42.42.2(pid=20031): stdout: | (launched: 2022-12-09_09:23:36.277234) 09:23:39.460673 run osmo-hlr_10.42.42.2(pid=20031): stderr: | [0;m[1;31m20221209092336452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092336452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092336452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092336452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092336452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092336452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092336464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092336473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092336473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092336473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:39.510828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20030): Terminating (SIGTERM) 09:23:39.550598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20033): Terminating (SIGTERM) 09:23:39.590133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20036): Terminating (SIGTERM) 09:23:39.629943 --- ParallelTerminationStrategy: PID 20030 died... 09:23:39.648778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20030): Terminated: ok {rc=0} 09:23:39.693248 --- ParallelTerminationStrategy: PID 20033 died... 09:23:39.711644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20033): Terminated: ok {rc=0} 09:23:39.755255 --- ParallelTerminationStrategy: PID 20036 died... 09:23:39.773789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20036): Terminated: ok {rc=0} 09:23:39.858213 bus /gobi_0: Setting Powered False 09:23:40.957619 bus /gobi_0: Setting Powered False 09:23:42.073141 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_sms:nanobts --------------------------------------------------------------------- 09:23:43.324595 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:43.328190 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 09:23:43.352412 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 09:23:43.360030 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 09:23:43.413084 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 09:23:43.436882 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 09:23:43.444484 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 09:23:43.982544 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 09:23:43.987465 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 09:23:43.998318 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 09:23:44.037081 tst mo_mt_sms.py: using LAC 20491 09:23:44.160246 tst mo_mt_sms.py: using RAC 91 09:23:44.299457 tst mo_mt_sms.py: using CellId 20491 09:23:44.426895 tst mo_mt_sms.py: using BVCI 20492 09:23:44.543130 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:23:44.659507 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:23:44.774461 tst mo_mt_sms.py:9: start nitb and bts... 09:23:44.975346 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:23:45.588112 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20042): Launched 09:23:45.909417 run osmo-nitb_10.42.42.2(pid=20043): Launched 09:23:46.097347 run osmo-nitb_10.42.42.2(pid=20043): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20043)] 09:23:46.233891 run osmo-nitb_10.42.42.2(pid=20043): stdout: | (launched: 2022-12-09_09:23:45.832128) 09:23:46.371928 run osmo-nitb_10.42.42.2(pid=20043): stderr: | (launched: 2022-12-09_09:23:45.898360) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:23:46.509828 run osmo-nitb_10.42.42.2(pid=20043): stdout: | (launched: 2022-12-09_09:23:45.832128) 09:23:46.641976 run osmo-nitb_10.42.42.2(pid=20043): stderr: | (launched: 2022-12-09_09:23:45.898360) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20043) [trial-2357↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20043)] 09:23:47.043668 tst osmo-nitb_10.42.42.2(pid=20043): stdout: | (launched: 2022-12-09_09:23:45.832128) 09:23:47.177127 tst osmo-nitb_10.42.42.2(pid=20043): stderr: | (launched: 2022-12-09_09:23:45.898360) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:23:47.332360 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20043) [trial-2357↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20043)] [trial-2357↪nitb_sms:nanobts↪mo_mt_sms.py:11] 09:23:47.341473 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 09:23:47.348825 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20042): Terminating (SIGTERM) 09:23:47.560635 --- ParallelTerminationStrategy: PID 20042 died... 09:23:47.581997 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20042): Terminated: ok {rc=0} 09:23:47.670052 bus /sierra_3: Setting Powered False 09:23:48.769167 bus /sierra_3: Setting Powered False 09:23:49.886131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:nanobts+band-1900 --------------------------------------------------------------------- 09:23:51.074010 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:51.078742 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:23:51.102758 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:23:51.130152 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 09:23:51.188270 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:23:51.212445 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:23:51.239508 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 09:23:51.781778 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 09:23:51.786581 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:51.797561 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:23:51.835638 tst mo_mt_sms.py: using LAC 20492 09:23:51.951029 tst mo_mt_sms.py: using RAC 92 09:23:52.066377 tst mo_mt_sms.py: using CellId 20492 09:23:52.183910 tst mo_mt_sms.py: using BVCI 20493 09:23:52.291796 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:52.302686 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:52.313520 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:52.324258 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:52.335005 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:52.345642 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:23:52.466030 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:23:52.587199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:53.085389 run create_hlr_db(pid=20048): Launched 09:23:53.209255 bus /sierra_2: Setting Powered False 09:23:54.269697 run create_hlr_db(pid=20048): Terminated: ok {rc=0} 09:23:54.697639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Launched 09:23:54.999644 run osmo-hlr_10.42.42.2(pid=20051): Launched 09:23:55.114211 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:55.645172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Launched 09:23:55.943181 run osmo-stp_10.42.42.5(pid=20054): Launched 09:23:56.056104 run osmo-msc_10.42.42.6: Starting osmo-msc 09:23:56.597146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20056): Launched 09:23:56.898017 run osmo-msc_10.42.42.6(pid=20057): Launched 09:23:57.065350 run osmo-stp_10.42.42.5(pid=20054): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] 09:23:57.191459 run osmo-stp_10.42.42.5(pid=20054): stdout: | (launched: 2022-12-09_09:23:55.887871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:57.317752 run osmo-stp_10.42.42.5(pid=20054): stderr: | [0;m[38;5;43m20221209092356058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092356058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092356059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092356059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092356059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092356060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092356060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:57.441919 run osmo-stp_10.42.42.5(pid=20054): stdout: | (launched: 2022-12-09_09:23:55.887871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:57.560500 run osmo-stp_10.42.42.5(pid=20054): stderr: | [0;m[38;5;43m20221209092356058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092356058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092356059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092356059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092356059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092356060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092356060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:57.703403 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20054): Process ended prematurely: osmo-stp_10.42.42.5(pid=20054) [trial-2357↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] [trial-2357↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 09:23:57.711724 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 09:23:57.737482 run osmo-hlr_10.42.42.2(pid=20051): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20051)] 09:23:57.784632 run osmo-hlr_10.42.42.2(pid=20051): stdout: | (launched: 2022-12-09_09:23:54.943866) 09:23:57.833520 run osmo-hlr_10.42.42.2(pid=20051): stderr: | [0;m[1;31m20221209092355118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092355118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092355118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092355118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092355118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092355118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092355130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092355139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092355139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092355139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:57.901749 run osmo-msc_10.42.42.6(pid=20057): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20057)] 09:23:57.948629 run osmo-msc_10.42.42.6(pid=20057): stdout: | (launched: 2022-12-09_09:23:56.841442) 09:23:57.997217 run osmo-msc_10.42.42.6(pid=20057): stderr: | [0;m[38;5;43m20221209092357112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092357112 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f95a4d76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092357112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092357112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092357113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092357113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092357114 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092357115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092357115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092357115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:23:58.046297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Terminating (SIGTERM) 09:23:58.085730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Terminating (SIGTERM) 09:23:58.125062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20056): Terminating (SIGTERM) 09:23:58.164566 --- ParallelTerminationStrategy: PID 20050 died... 09:23:58.183571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Terminated: ok {rc=0} 09:23:58.226899 --- ParallelTerminationStrategy: PID 20053 died... 09:23:58.245276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Terminated: ok {rc=0} 09:23:58.288543 --- ParallelTerminationStrategy: PID 20056 died... 09:23:58.306974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20056): Terminated: ok {rc=0} 09:23:58.389058 bus /sierra_3: Setting Powered False 09:23:59.485656 bus /sierra_3: Setting Powered False 09:24:00.601378 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:24:01.856810 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:01.863214 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:24:01.892845 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 09:24:01.902370 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:24:01.943444 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:24:01.989336 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 09:24:02.001158 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:24:02.494901 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:24:02.501524 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 09:24:02.512937 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:24:02.553667 tst assert_extension.py: using LAC 20493 09:24:02.679987 tst assert_extension.py: using RAC 93 09:24:02.804232 tst assert_extension.py: using CellId 20493 09:24:02.928144 tst assert_extension.py: using BVCI 20494 09:24:03.043066 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:24:03.156324 tst assert_extension.py:10: start nitb and bts... 09:24:03.352207 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:24:03.954784 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20062): Launched 09:24:04.249574 run osmo-nitb_10.42.42.2(pid=20063): Launched 09:24:04.412585 run osmo-nitb_10.42.42.2(pid=20063): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20063)] 09:24:04.544761 run osmo-nitb_10.42.42.2(pid=20063): stdout: | (launched: 2022-12-09_09:24:04.194946) 09:24:04.678366 run osmo-nitb_10.42.42.2(pid=20063): stderr: | (launched: 2022-12-09_09:24:04.238841) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:24:04.811911 run osmo-nitb_10.42.42.2(pid=20063): stdout: | (launched: 2022-12-09_09:24:04.194946) 09:24:04.940051 run osmo-nitb_10.42.42.2(pid=20063): stderr: | (launched: 2022-12-09_09:24:04.238841) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20063): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20063) [trial-2357↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20063)] 09:24:05.360933 tst osmo-nitb_10.42.42.2(pid=20063): stdout: | (launched: 2022-12-09_09:24:04.194946) 09:24:05.480079 tst osmo-nitb_10.42.42.2(pid=20063): stderr: | (launched: 2022-12-09_09:24:04.238841) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:24:05.620509 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20063): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20063) [trial-2357↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20063)] [trial-2357↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 09:24:05.629054 tst assert_extension.py:12: Test FAILED (3.1 sec) 09:24:05.635637 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20062): Terminating (SIGTERM) 09:24:05.844423 --- ParallelTerminationStrategy: PID 20062 died... 09:24:05.865077 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20062): Terminated: ok {rc=0} 09:24:05.950181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:24:07.123482 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:07.128769 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:24:07.154555 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:24:07.182439 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:24:07.219308 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:24:07.243185 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:24:07.270224 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:24:07.803004 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:24:07.808498 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:24:07.819999 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:24:07.860281 tst assert_extension.py: using LAC 20494 09:24:07.977542 tst assert_extension.py: using RAC 94 09:24:08.093342 tst assert_extension.py: using CellId 20494 09:24:08.209737 tst assert_extension.py: using BVCI 20495 09:24:08.316342 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:24:08.327352 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:24:08.338194 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:24:08.348765 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:24:08.359399 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:24:08.370060 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:24:08.487878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:08.977183 run create_hlr_db(pid=20067): Launched 09:24:09.098923 bus /sierra_2: Setting Powered False 09:24:10.161183 run create_hlr_db(pid=20067): Terminated: ok {rc=0} 09:24:10.588433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20069): Launched 09:24:10.884501 run osmo-hlr_10.42.42.2(pid=20070): Launched 09:24:10.996875 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:11.521287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20072): Launched 09:24:11.818827 run osmo-stp_10.42.42.5(pid=20073): Launched 09:24:11.931492 run osmo-msc_10.42.42.6: Starting osmo-msc 09:24:12.463827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20075): Launched 09:24:12.759300 run osmo-msc_10.42.42.6(pid=20076): Launched 09:24:12.924016 run osmo-stp_10.42.42.5(pid=20073): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20073)] 09:24:13.049333 run osmo-stp_10.42.42.5(pid=20073): stdout: | (launched: 2022-12-09_09:24:11.762842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:13.173831 run osmo-stp_10.42.42.5(pid=20073): stderr: | [0;m[38;5;43m20221209092411929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092411929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092411929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092411929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092411930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092411930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092411930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:13.296156 run osmo-stp_10.42.42.5(pid=20073): stdout: | (launched: 2022-12-09_09:24:11.762842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:13.413467 run osmo-stp_10.42.42.5(pid=20073): stderr: | [0;m[38;5;43m20221209092411929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092411929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092411929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092411929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092411930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092411930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092411930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:13.553631 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20073): Process ended prematurely: osmo-stp_10.42.42.5(pid=20073) [trial-2357↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20073)] [trial-2357↪ussd:nanobts+band-1900↪assert_extension.py:17] 09:24:13.561700 tst assert_extension.py:17: Test FAILED (5.7 sec) 09:24:13.587447 run osmo-hlr_10.42.42.2(pid=20070): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20070)] 09:24:13.634571 run osmo-hlr_10.42.42.2(pid=20070): stdout: | (launched: 2022-12-09_09:24:10.829955) 09:24:13.683550 run osmo-hlr_10.42.42.2(pid=20070): stderr: | [0;m[1;31m20221209092411001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092411001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092411001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092411001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092411001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092411001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092411014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092411025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092411025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092411025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:13.752215 run osmo-msc_10.42.42.6(pid=20076): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20076)] 09:24:13.799595 run osmo-msc_10.42.42.6(pid=20076): stdout: | (launched: 2022-12-09_09:24:12.704260) 09:24:13.848638 run osmo-msc_10.42.42.6(pid=20076): stderr: | [0;m[38;5;43m20221209092412974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092412974 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17f9fbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092412974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092412974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092412974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092412975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092412976 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092412977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092412977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092412977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:24:13.898077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20069): Terminating (SIGTERM) 09:24:13.937171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20072): Terminating (SIGTERM) 09:24:13.976546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20075): Terminating (SIGTERM) 09:24:14.016632 --- ParallelTerminationStrategy: PID 20069 died... 09:24:14.035728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20069): Terminated: ok {rc=0} 09:24:14.079469 --- ParallelTerminationStrategy: PID 20072 died... 09:24:14.098100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20072): Terminated: ok {rc=0} 09:24:14.141897 --- ParallelTerminationStrategy: PID 20075 died... 09:24:14.160504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20075): Terminated: ok {rc=0} 09:24:14.246224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:24:15.446529 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:15.453922 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:24:15.477598 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:24:15.504251 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:24:15.559178 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:24:15.585779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:24:15.614565 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:24:16.189943 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:24:16.259268 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:16.274764 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:24:16.344320 tst mo_mt_call.py: using LAC 20495 09:24:16.494858 tst mo_mt_call.py: using RAC 95 09:24:16.650479 tst mo_mt_call.py: using CellId 20495 09:24:16.781700 tst mo_mt_call.py: using BVCI 20496 09:24:16.906477 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:16.919726 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:16.934234 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:16.948374 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:16.961643 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:16.976717 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:24:17.106860 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:24:17.241904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:17.707206 run create_hlr_db(pid=20081): Launched 09:24:17.830187 bus /sierra_2: Setting Powered False 09:24:18.889141 run create_hlr_db(pid=20081): Terminated: ok {rc=0} 09:24:19.325687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Launched 09:24:19.646394 run osmo-hlr_10.42.42.2(pid=20084): Launched 09:24:19.769507 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:20.319324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Launched 09:24:20.638475 run osmo-stp_10.42.42.5(pid=20087): Launched 09:24:20.763466 run osmo-msc_10.42.42.6: Starting osmo-msc 09:24:21.337521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20089): Launched 09:24:21.654448 run osmo-msc_10.42.42.6(pid=20090): Launched 09:24:21.831293 run osmo-stp_10.42.42.5(pid=20087): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] 09:24:21.965458 run osmo-stp_10.42.42.5(pid=20087): stdout: | (launched: 2022-12-09_09:24:20.580172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:22.100689 run osmo-stp_10.42.42.5(pid=20087): stderr: | [0;m[38;5;43m20221209092420767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092420767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092420767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092420768 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092420768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092420768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092420768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:22.234076 run osmo-stp_10.42.42.5(pid=20087): stdout: | (launched: 2022-12-09_09:24:20.580172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:22.361424 run osmo-stp_10.42.42.5(pid=20087): stderr: | [0;m[38;5;43m20221209092420767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092420767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092420767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092420768 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092420768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092420768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092420768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:22.513788 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20087): Process ended prematurely: osmo-stp_10.42.42.5(pid=20087) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:24:22.523433 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:24:22.551904 run osmo-hlr_10.42.42.2(pid=20084): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20084)] 09:24:22.601903 run osmo-hlr_10.42.42.2(pid=20084): stdout: | (launched: 2022-12-09_09:24:19.588194) 09:24:22.653760 run osmo-hlr_10.42.42.2(pid=20084): stderr: | [0;m[1;31m20221209092419781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092419781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092419781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092419781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092419781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092419781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092419792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092419801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092419802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092419802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:22.725922 run osmo-msc_10.42.42.6(pid=20090): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20090)] 09:24:22.775909 run osmo-msc_10.42.42.6(pid=20090): stdout: | (launched: 2022-12-09_09:24:21.596652) 09:24:22.827451 run osmo-msc_10.42.42.6(pid=20090): stderr: | [0;m[38;5;43m20221209092421915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092421915 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f33cf2ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092421915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092421915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092421915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092421916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092421917 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092421918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092421918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092421918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:24:22.879326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Terminating (SIGTERM) 09:24:22.920888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Terminating (SIGTERM) 09:24:22.962831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20089): Terminating (SIGTERM) 09:24:23.005030 --- ParallelTerminationStrategy: PID 20083 died... 09:24:23.025242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20083): Terminated: ok {rc=0} 09:24:23.071712 --- ParallelTerminationStrategy: PID 20086 died... 09:24:23.091212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20086): Terminated: ok {rc=0} 09:24:23.137383 --- ParallelTerminationStrategy: PID 20089 died... 09:24:23.156725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20089): Terminated: ok {rc=0} 09:24:23.243152 bus /sierra_3: Setting Powered False 09:24:24.341850 bus /sierra_3: Setting Powered False 09:24:25.457697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:24:26.605083 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:26.617523 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:24:26.679427 tst mo_mt_call_osmux.py: using LAC 20496 09:24:26.808181 tst mo_mt_call_osmux.py: using RAC 96 09:24:26.932378 tst mo_mt_call_osmux.py: using CellId 20496 09:24:27.054958 tst mo_mt_call_osmux.py: using BVCI 20497 09:24:27.169914 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:27.181588 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:27.192921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:27.204788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:27.216734 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:24:27.229329 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:24:27.347832 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:24:27.466899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:27.961024 run create_hlr_db(pid=20092): Launched 09:24:28.082255 bus /sierra_2: Setting Powered False 09:24:29.145537 run create_hlr_db(pid=20092): Terminated: ok {rc=0} 09:24:29.569760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20094): Launched 09:24:29.867707 run osmo-hlr_10.42.42.2(pid=20095): Launched 09:24:29.981373 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:30.496546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20097): Launched 09:24:30.794366 run osmo-stp_10.42.42.5(pid=20098): Launched 09:24:30.991462 run osmo-msc_10.42.42.6: Starting osmo-msc 09:24:31.717503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20100): Launched 09:24:32.132878 run osmo-msc_10.42.42.6(pid=20101): Launched 09:24:32.453095 run osmo-stp_10.42.42.5(pid=20098): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20098)] 09:24:32.617805 run osmo-stp_10.42.42.5(pid=20098): stdout: | (launched: 2022-12-09_09:24:30.739592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:32.755242 run osmo-stp_10.42.42.5(pid=20098): stderr: | [0;m[38;5;43m20221209092430989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092430990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092430990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092430990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092430991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092430991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092430991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:32.888557 run osmo-stp_10.42.42.5(pid=20098): stdout: | (launched: 2022-12-09_09:24:30.739592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:33.016304 run osmo-stp_10.42.42.5(pid=20098): stderr: | [0;m[38;5;43m20221209092430989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092430990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092430990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092430990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092430991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092430991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092430991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:33.168679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20098): Process ended prematurely: osmo-stp_10.42.42.5(pid=20098) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20098)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:24:33.178349 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:24:33.206252 run osmo-hlr_10.42.42.2(pid=20095): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20095)] 09:24:33.256519 run osmo-hlr_10.42.42.2(pid=20095): stdout: | (launched: 2022-12-09_09:24:29.813186) 09:24:33.308275 run osmo-hlr_10.42.42.2(pid=20095): stderr: | [0;m[1;31m20221209092429985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092429985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092429985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092429985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092429985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092429985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092429997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092430006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092430006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092430006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:33.380522 run osmo-msc_10.42.42.6(pid=20101): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20101)] 09:24:33.430294 run osmo-msc_10.42.42.6(pid=20101): stdout: | (launched: 2022-12-09_09:24:32.056601) 09:24:33.481681 run osmo-msc_10.42.42.6(pid=20101): stderr: | [0;m[38;5;43m20221209092432542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092432542 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8a293f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092432542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092432542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092432542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092432543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092432544 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092432545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092432545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092432545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:24:33.533746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20094): Terminating (SIGTERM) 09:24:33.575642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20097): Terminating (SIGTERM) 09:24:33.617332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20100): Terminating (SIGTERM) 09:24:33.659402 --- ParallelTerminationStrategy: PID 20094 died... 09:24:33.679324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20094): Terminated: ok {rc=0} 09:24:33.725774 --- ParallelTerminationStrategy: PID 20097 died... 09:24:33.745355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20097): Terminated: ok {rc=0} 09:24:33.791507 --- ParallelTerminationStrategy: PID 20100 died... 09:24:33.811006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20100): Terminated: ok {rc=0} 09:24:33.898664 bus /sierra_3: Setting Powered False 09:24:34.996823 bus /sierra_3: Setting Powered False 09:24:36.112356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:24:37.358719 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:37.366485 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:24:37.392042 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:24:37.419508 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:24:37.472536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:24:37.497328 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:24:37.525268 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:24:38.080250 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:24:38.130651 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:38.142084 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:24:38.202080 tst mo_mt_call.py: using LAC 20497 09:24:38.319997 tst mo_mt_call.py: using RAC 97 09:24:38.446113 tst mo_mt_call.py: using CellId 20497 09:24:38.573288 tst mo_mt_call.py: using BVCI 20498 09:24:38.682655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:38.694131 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:38.705351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:38.717197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:38.729021 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:38.740732 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:24:38.860368 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:24:38.980377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:39.474291 run create_hlr_db(pid=20106): Launched 09:24:39.595505 bus /sierra_2: Setting Powered False 09:24:40.658606 run create_hlr_db(pid=20106): Terminated: ok {rc=0} 09:24:41.081239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20108): Launched 09:24:41.385206 run osmo-hlr_10.42.42.2(pid=20109): Launched 09:24:41.498999 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:42.053437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20111): Launched 09:24:42.371542 run osmo-stp_10.42.42.5(pid=20112): Launched 09:24:42.493064 run osmo-msc_10.42.42.6: Starting osmo-msc 09:24:43.069164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20114): Launched 09:24:43.388187 run osmo-msc_10.42.42.6(pid=20115): Launched 09:24:43.566177 run osmo-stp_10.42.42.5(pid=20112): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20112)] 09:24:43.701106 run osmo-stp_10.42.42.5(pid=20112): stdout: | (launched: 2022-12-09_09:24:42.313744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:43.836080 run osmo-stp_10.42.42.5(pid=20112): stderr: | [0;m[38;5;43m20221209092442499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092442500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092442500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092442500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092442501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092442501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092442501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:43.969915 run osmo-stp_10.42.42.5(pid=20112): stdout: | (launched: 2022-12-09_09:24:42.313744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:44.098669 run osmo-stp_10.42.42.5(pid=20112): stderr: | [0;m[38;5;43m20221209092442499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092442500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092442500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092442500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092442501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092442501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092442501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:44.251619 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20112): Process ended prematurely: osmo-stp_10.42.42.5(pid=20112) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20112)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:24:44.261322 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:24:44.289759 run osmo-hlr_10.42.42.2(pid=20109): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20109)] 09:24:44.339638 run osmo-hlr_10.42.42.2(pid=20109): stdout: | (launched: 2022-12-09_09:24:41.331950) 09:24:44.391164 run osmo-hlr_10.42.42.2(pid=20109): stderr: | [0;m[1;31m20221209092441503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092441503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092441503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092441503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092441503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092441503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092441515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092441524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092441524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092441524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:44.462791 run osmo-msc_10.42.42.6(pid=20115): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20115)] 09:24:44.512150 run osmo-msc_10.42.42.6(pid=20115): stdout: | (launched: 2022-12-09_09:24:43.330333) 09:24:44.563459 run osmo-msc_10.42.42.6(pid=20115): stderr: | [0;m[38;5;43m20221209092443647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092443647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe73ad0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092443647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092443647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092443647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092443647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092443649 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092443650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092443650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092443650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:24:44.615278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20108): Terminating (SIGTERM) 09:24:44.657041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20111): Terminating (SIGTERM) 09:24:44.698771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20114): Terminating (SIGTERM) 09:24:44.740724 --- ParallelTerminationStrategy: PID 20108 died... 09:24:44.760593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20108): Terminated: ok {rc=0} 09:24:44.807037 --- ParallelTerminationStrategy: PID 20111 died... 09:24:44.826539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20111): Terminated: ok {rc=0} 09:24:44.872768 --- ParallelTerminationStrategy: PID 20114 died... 09:24:44.892226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20114): Terminated: ok {rc=0} 09:24:44.979547 bus /sierra_3: Setting Powered False 09:24:46.076930 bus /sierra_3: Setting Powered False 09:24:47.195606 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:24:48.347632 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:48.360188 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:24:48.422463 tst mo_mt_call_osmux.py: using LAC 20498 09:24:48.541334 tst mo_mt_call_osmux.py: using RAC 98 09:24:48.658472 tst mo_mt_call_osmux.py: using CellId 20498 09:24:48.777828 tst mo_mt_call_osmux.py: using BVCI 20499 09:24:48.887542 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:48.899024 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:48.910312 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:48.921644 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:48.932791 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:24:48.943959 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:24:49.062093 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:24:49.180842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:49.642884 run create_hlr_db(pid=20117): Launched 09:24:49.764567 bus /sierra_2: Setting Powered False 09:24:50.824880 run create_hlr_db(pid=20117): Terminated: ok {rc=0} 09:24:51.260019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20119): Launched 09:24:51.579102 run osmo-hlr_10.42.42.2(pid=20120): Launched 09:24:51.701502 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:52.248341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20122): Launched 09:24:52.567035 run osmo-stp_10.42.42.5(pid=20123): Launched 09:24:52.688345 run osmo-msc_10.42.42.6: Starting osmo-msc 09:24:53.264422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20125): Launched 09:24:53.583618 run osmo-msc_10.42.42.6(pid=20126): Launched 09:24:53.762205 run osmo-stp_10.42.42.5(pid=20123): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20123)] 09:24:53.896934 run osmo-stp_10.42.42.5(pid=20123): stdout: | (launched: 2022-12-09_09:24:52.509404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:54.036156 run osmo-stp_10.42.42.5(pid=20123): stderr: | [0;m[38;5;43m20221209092452695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092452695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092452695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092452695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092452696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092452696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092452696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:54.170227 run osmo-stp_10.42.42.5(pid=20123): stdout: | (launched: 2022-12-09_09:24:52.509404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:54.298342 run osmo-stp_10.42.42.5(pid=20123): stderr: | [0;m[38;5;43m20221209092452695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092452695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092452695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092452695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092452696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092452696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092452696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:54.451319 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20123): Process ended prematurely: osmo-stp_10.42.42.5(pid=20123) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20123)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:24:54.460739 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:24:54.488755 run osmo-hlr_10.42.42.2(pid=20120): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20120)] 09:24:54.538806 run osmo-hlr_10.42.42.2(pid=20120): stdout: | (launched: 2022-12-09_09:24:51.521345) 09:24:54.590334 run osmo-hlr_10.42.42.2(pid=20120): stderr: | [0;m[1;31m20221209092451713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092451713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092451713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092451713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092451713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092451713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092451724 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092451733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092451733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092451733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:54.662165 run osmo-msc_10.42.42.6(pid=20126): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20126)] 09:24:54.711858 run osmo-msc_10.42.42.6(pid=20126): stdout: | (launched: 2022-12-09_09:24:53.525756) 09:24:54.763397 run osmo-msc_10.42.42.6(pid=20126): stderr: | [0;m[38;5;43m20221209092453843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092453843 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f69c31e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092453843 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092453844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092453844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092453844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092453846 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092453846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092453846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092453846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:24:54.815377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20119): Terminating (SIGTERM) 09:24:54.856930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20122): Terminating (SIGTERM) 09:24:54.898559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20125): Terminating (SIGTERM) 09:24:54.940321 --- ParallelTerminationStrategy: PID 20119 died... 09:24:54.960143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20119): Terminated: ok {rc=0} 09:24:55.006359 --- ParallelTerminationStrategy: PID 20122 died... 09:24:55.026143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20122): Terminated: ok {rc=0} 09:24:55.071918 --- ParallelTerminationStrategy: PID 20125 died... 09:24:55.091528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20125): Terminated: ok {rc=0} 09:24:55.178450 bus /sierra_3: Setting Powered False 09:24:56.276695 bus /sierra_3: Setting Powered False 09:24:57.390958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:24:58.627202 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:58.636248 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:24:58.661866 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:24:58.689839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:24:58.748213 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:24:58.774157 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:24:58.802259 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:24:59.351774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:24:59.403611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:24:59.415550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:24:59.474944 tst mo_mt_call.py: using LAC 20499 09:24:59.598870 tst mo_mt_call.py: using RAC 99 09:24:59.723489 tst mo_mt_call.py: using CellId 20499 09:24:59.846136 tst mo_mt_call.py: using BVCI 20500 09:24:59.961848 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:24:59.973643 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:24:59.985247 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:24:59.997084 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:00.009253 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:00.021658 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:25:00.139481 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:25:00.261667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:00.757113 run create_hlr_db(pid=20131): Launched 09:25:00.908371 bus /sierra_2: Setting Powered False 09:25:01.984894 run create_hlr_db(pid=20131): Terminated: ok {rc=0} 09:25:02.421591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20136): Launched 09:25:02.719791 run osmo-hlr_10.42.42.2(pid=20137): Launched 09:25:02.832878 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:03.362212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20139): Launched 09:25:03.660393 run osmo-stp_10.42.42.5(pid=20140): Launched 09:25:03.774596 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:04.314530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20142): Launched 09:25:04.613288 run osmo-msc_10.42.42.6(pid=20143): Launched 09:25:04.781091 run osmo-stp_10.42.42.5(pid=20140): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20140)] 09:25:04.907111 run osmo-stp_10.42.42.5(pid=20140): stdout: | (launched: 2022-12-09_09:25:03.605807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:05.033564 run osmo-stp_10.42.42.5(pid=20140): stderr: | [0;m[38;5;43m20221209092503771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092503771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092503772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092503772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092503773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092503773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092503773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:05.157958 run osmo-stp_10.42.42.5(pid=20140): stdout: | (launched: 2022-12-09_09:25:03.605807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:05.277386 run osmo-stp_10.42.42.5(pid=20140): stderr: | [0;m[38;5;43m20221209092503771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092503771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092503772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092503772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092503773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092503773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092503773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:05.419992 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20140): Process ended prematurely: osmo-stp_10.42.42.5(pid=20140) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20140)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:25:05.429013 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:25:05.455234 run osmo-hlr_10.42.42.2(pid=20137): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20137)] 09:25:05.502221 run osmo-hlr_10.42.42.2(pid=20137): stdout: | (launched: 2022-12-09_09:25:02.665369) 09:25:05.550910 run osmo-hlr_10.42.42.2(pid=20137): stderr: | [0;m[1;31m20221209092502838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092502838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092502838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092502838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092502838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092502838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092502850 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092502860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092502860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092502860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:05.619004 run osmo-msc_10.42.42.6(pid=20143): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20143)] 09:25:05.665839 run osmo-msc_10.42.42.6(pid=20143): stdout: | (launched: 2022-12-09_09:25:04.558574) 09:25:05.714780 run osmo-msc_10.42.42.6(pid=20143): stderr: | [0;m[38;5;43m20221209092504828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092504828 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff83b3ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092504828 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092504828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092504829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092504829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092504831 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092504831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092504831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092504831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:05.763835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20136): Terminating (SIGTERM) 09:25:05.803138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20139): Terminating (SIGTERM) 09:25:05.842468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20142): Terminating (SIGTERM) 09:25:05.882180 --- ParallelTerminationStrategy: PID 20136 died... 09:25:05.901040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20136): Terminated: ok {rc=0} 09:25:05.945069 --- ParallelTerminationStrategy: PID 20139 died... 09:25:05.963558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20139): Terminated: ok {rc=0} 09:25:06.006978 --- ParallelTerminationStrategy: PID 20142 died... 09:25:06.025274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20142): Terminated: ok {rc=0} 09:25:06.107303 bus /sierra_3: Setting Powered False 09:25:07.201225 bus /sierra_3: Setting Powered False 09:25:08.313109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:25:09.457835 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:09.470124 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:25:09.531159 tst mo_mt_call_osmux.py: using LAC 20500 09:25:09.650180 tst mo_mt_call_osmux.py: using RAC 100 09:25:09.768646 tst mo_mt_call_osmux.py: using CellId 20500 09:25:09.885618 tst mo_mt_call_osmux.py: using BVCI 20501 09:25:10.003284 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:10.015274 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:10.027184 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:10.039869 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:10.052295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:25:10.064382 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:25:10.182826 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:25:10.305489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:10.799897 run create_hlr_db(pid=20145): Launched 09:25:10.920773 bus /sierra_2: Setting Powered False 09:25:11.984344 run create_hlr_db(pid=20145): Terminated: ok {rc=0} 09:25:12.410683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20147): Launched 09:25:12.708424 run osmo-hlr_10.42.42.2(pid=20148): Launched 09:25:12.822606 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:13.348835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20150): Launched 09:25:13.646890 run osmo-stp_10.42.42.5(pid=20151): Launched 09:25:13.760341 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:14.305366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20153): Launched 09:25:14.604841 run osmo-msc_10.42.42.6(pid=20154): Launched 09:25:14.772702 run osmo-stp_10.42.42.5(pid=20151): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20151)] 09:25:14.899041 run osmo-stp_10.42.42.5(pid=20151): stdout: | (launched: 2022-12-09_09:25:13.592366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:15.025986 run osmo-stp_10.42.42.5(pid=20151): stderr: | [0;m[38;5;43m20221209092513757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092513757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092513758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092513758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092513759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092513759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092513759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:15.150757 run osmo-stp_10.42.42.5(pid=20151): stdout: | (launched: 2022-12-09_09:25:13.592366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:15.270804 run osmo-stp_10.42.42.5(pid=20151): stderr: | [0;m[38;5;43m20221209092513757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092513757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092513758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092513758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092513759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092513759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092513759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:15.413948 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20151): Process ended prematurely: osmo-stp_10.42.42.5(pid=20151) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20151)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:25:15.422890 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:25:15.449265 run osmo-hlr_10.42.42.2(pid=20148): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20148)] 09:25:15.496282 run osmo-hlr_10.42.42.2(pid=20148): stdout: | (launched: 2022-12-09_09:25:12.653804) 09:25:15.544937 run osmo-hlr_10.42.42.2(pid=20148): stderr: | [0;m[1;31m20221209092512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092512839 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092512848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092512848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092512848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:15.612546 run osmo-msc_10.42.42.6(pid=20154): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20154)] 09:25:15.660192 run osmo-msc_10.42.42.6(pid=20154): stdout: | (launched: 2022-12-09_09:25:14.550120) 09:25:15.708727 run osmo-msc_10.42.42.6(pid=20154): stderr: | [0;m[38;5;43m20221209092514818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092514818 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef9b04dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092514819 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092514819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092514819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092514819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092514821 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092514822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092514822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092514822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:15.757667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20147): Terminating (SIGTERM) 09:25:15.796863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20150): Terminating (SIGTERM) 09:25:15.836361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20153): Terminating (SIGTERM) 09:25:15.899251 --- ParallelTerminationStrategy: PID 20147 died... 09:25:15.931569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20147): Terminated: ok {rc=0} 09:25:15.978660 --- ParallelTerminationStrategy: PID 20150 died... 09:25:15.997831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20150): Terminated: ok {rc=0} 09:25:16.042851 --- ParallelTerminationStrategy: PID 20153 died... 09:25:16.061973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20153): Terminated: ok {rc=0} 09:25:16.146689 bus /sierra_3: Setting Powered False 09:25:17.239516 bus /sierra_3: Setting Powered False 09:25:18.350293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:25:19.592075 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:19.599952 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:25:19.625973 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:25:19.653541 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:25:19.706861 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:25:19.731852 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:25:19.759729 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:25:20.314294 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:25:20.366090 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:20.378052 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:25:20.438856 tst mo_mt_call.py: using LAC 20501 09:25:20.562813 tst mo_mt_call.py: using RAC 101 09:25:20.689144 tst mo_mt_call.py: using CellId 20501 09:25:20.813457 tst mo_mt_call.py: using BVCI 20502 09:25:20.930870 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:20.942761 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:20.954415 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:20.966403 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:20.978727 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:20.990734 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:25:21.108556 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:25:21.227739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:21.721376 run create_hlr_db(pid=20159): Launched 09:25:21.842552 bus /sierra_2: Setting Powered False 09:25:22.905802 run create_hlr_db(pid=20159): Terminated: ok {rc=0} 09:25:23.332059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Launched 09:25:23.630500 run osmo-hlr_10.42.42.2(pid=20162): Launched 09:25:23.744090 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:24.256789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Launched 09:25:24.555401 run osmo-stp_10.42.42.5(pid=20165): Launched 09:25:24.670842 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:25.210852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20167): Launched 09:25:25.507783 run osmo-msc_10.42.42.6(pid=20168): Launched 09:25:25.675220 run osmo-stp_10.42.42.5(pid=20165): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] 09:25:25.800622 run osmo-stp_10.42.42.5(pid=20165): stdout: | (launched: 2022-12-09_09:25:24.500918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:25.927729 run osmo-stp_10.42.42.5(pid=20165): stderr: | [0;m[38;5;43m20221209092524670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092524670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092524670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092524671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092524671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092524671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092524671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:26.051263 run osmo-stp_10.42.42.5(pid=20165): stdout: | (launched: 2022-12-09_09:25:24.500918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:26.170135 run osmo-stp_10.42.42.5(pid=20165): stderr: | [0;m[38;5;43m20221209092524670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092524670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092524670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092524671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092524671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092524671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092524671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:26.311767 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20165): Process ended prematurely: osmo-stp_10.42.42.5(pid=20165) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:25:26.321304 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:25:26.347596 run osmo-hlr_10.42.42.2(pid=20162): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20162)] 09:25:26.395025 run osmo-hlr_10.42.42.2(pid=20162): stdout: | (launched: 2022-12-09_09:25:23.575293) 09:25:26.443639 run osmo-hlr_10.42.42.2(pid=20162): stderr: | [0;m[1;31m20221209092523746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092523747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092523747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092523747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092523747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092523747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092523759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092523767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092523767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092523767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:26.511455 run osmo-msc_10.42.42.6(pid=20168): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20168)] 09:25:26.558898 run osmo-msc_10.42.42.6(pid=20168): stdout: | (launched: 2022-12-09_09:25:25.453370) 09:25:26.607295 run osmo-msc_10.42.42.6(pid=20168): stderr: | [0;m[38;5;43m20221209092525721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092525721 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f13db5ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092525721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092525721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092525722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092525722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092525723 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092525724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092525724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092525724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:26.655830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Terminating (SIGTERM) 09:25:26.694806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Terminating (SIGTERM) 09:25:26.733699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20167): Terminating (SIGTERM) 09:25:26.773142 --- ParallelTerminationStrategy: PID 20161 died... 09:25:26.791929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20161): Terminated: ok {rc=0} 09:25:26.835116 --- ParallelTerminationStrategy: PID 20164 died... 09:25:26.853370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20164): Terminated: ok {rc=0} 09:25:26.896714 --- ParallelTerminationStrategy: PID 20167 died... 09:25:26.915094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20167): Terminated: ok {rc=0} 09:25:26.998595 bus /sierra_3: Setting Powered False 09:25:28.096665 bus /sierra_3: Setting Powered False 09:25:29.208446 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:25:30.355258 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:30.367862 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:25:30.429893 tst mo_mt_call_osmux.py: using LAC 20502 09:25:30.554385 tst mo_mt_call_osmux.py: using RAC 102 09:25:30.678693 tst mo_mt_call_osmux.py: using CellId 20502 09:25:30.808859 tst mo_mt_call_osmux.py: using BVCI 20503 09:25:30.938262 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:30.950968 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:30.964678 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:30.978560 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:30.991502 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:25:31.006192 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:25:31.132843 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:25:31.258990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:31.812861 run create_hlr_db(pid=20170): Launched 09:25:31.985955 bus /sierra_2: Setting Powered False 09:25:33.049304 run create_hlr_db(pid=20170): Terminated: ok {rc=0} 09:25:33.475042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20172): Launched 09:25:33.773439 run osmo-hlr_10.42.42.2(pid=20173): Launched 09:25:33.886022 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:34.397632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20175): Launched 09:25:34.695024 run osmo-stp_10.42.42.5(pid=20176): Launched 09:25:34.807632 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:35.346410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20178): Launched 09:25:35.643337 run osmo-msc_10.42.42.6(pid=20179): Launched 09:25:35.809708 run osmo-stp_10.42.42.5(pid=20176): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20176)] 09:25:35.935195 run osmo-stp_10.42.42.5(pid=20176): stdout: | (launched: 2022-12-09_09:25:34.640526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:36.060913 run osmo-stp_10.42.42.5(pid=20176): stderr: | [0;m[38;5;43m20221209092534807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092534808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092534808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092534808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092534809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092534809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092534809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:36.185192 run osmo-stp_10.42.42.5(pid=20176): stdout: | (launched: 2022-12-09_09:25:34.640526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:36.304011 run osmo-stp_10.42.42.5(pid=20176): stderr: | [0;m[38;5;43m20221209092534807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092534808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092534808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092534808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092534809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092534809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092534809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:36.446639 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20176): Process ended prematurely: osmo-stp_10.42.42.5(pid=20176) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20176)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:25:36.455467 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:25:36.481510 run osmo-hlr_10.42.42.2(pid=20173): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20173)] 09:25:36.528526 run osmo-hlr_10.42.42.2(pid=20173): stdout: | (launched: 2022-12-09_09:25:33.718693) 09:25:36.577363 run osmo-hlr_10.42.42.2(pid=20173): stderr: | [0;m[1;31m20221209092533891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092533891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092533891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092533892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092533892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092533892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092533909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092533917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092533917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092533917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:36.645363 run osmo-msc_10.42.42.6(pid=20179): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20179)] 09:25:36.692488 run osmo-msc_10.42.42.6(pid=20179): stdout: | (launched: 2022-12-09_09:25:35.588881) 09:25:36.741164 run osmo-msc_10.42.42.6(pid=20179): stderr: | [0;m[38;5;43m20221209092535859 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092535859 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa9e1353c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092535859 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092535859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092535859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092535860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092535862 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092535863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092535863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092535863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:36.789858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20172): Terminating (SIGTERM) 09:25:36.828864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20175): Terminating (SIGTERM) 09:25:36.867769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20178): Terminating (SIGTERM) 09:25:36.906952 --- ParallelTerminationStrategy: PID 20172 died... 09:25:36.925768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20172): Terminated: ok {rc=0} 09:25:36.969379 --- ParallelTerminationStrategy: PID 20175 died... 09:25:36.987504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20175): Terminated: ok {rc=0} 09:25:37.030687 --- ParallelTerminationStrategy: PID 20178 died... 09:25:37.049078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20178): Terminated: ok {rc=0} 09:25:37.133208 bus /sierra_3: Setting Powered False 09:25:38.231893 bus /sierra_3: Setting Powered False 09:25:39.345676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:25:40.585807 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:40.592790 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:25:40.616758 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:25:40.643497 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:25:40.694946 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:25:40.718778 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:25:40.745505 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:25:41.300714 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:25:41.348027 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:41.359480 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:25:41.419508 tst mo_mt_call.py: using LAC 20503 09:25:41.537261 tst mo_mt_call.py: using RAC 103 09:25:41.654718 tst mo_mt_call.py: using CellId 20503 09:25:41.772905 tst mo_mt_call.py: using BVCI 20504 09:25:41.879882 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:41.893889 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:41.905669 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:41.917449 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:41.929213 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:41.940801 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:25:42.060770 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:25:42.181517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:42.676601 run create_hlr_db(pid=20184): Launched 09:25:42.798694 bus /sierra_2: Setting Powered False 09:25:43.861969 run create_hlr_db(pid=20184): Terminated: ok {rc=0} 09:25:44.286684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Launched 09:25:44.585546 run osmo-hlr_10.42.42.2(pid=20187): Launched 09:25:44.699926 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:45.212681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Launched 09:25:45.510174 run osmo-stp_10.42.42.5(pid=20190): Launched 09:25:45.623923 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:46.198307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20192): Launched 09:25:46.534427 run osmo-msc_10.42.42.6(pid=20193): Launched 09:25:46.965928 run osmo-stp_10.42.42.5(pid=20190): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] 09:25:47.240353 run osmo-stp_10.42.42.5(pid=20190): stdout: | (launched: 2022-12-09_09:25:45.455701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:47.371178 run osmo-stp_10.42.42.5(pid=20190): stderr: | [0;m[38;5;43m20221209092545622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092545622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092545622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092545624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092545624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092545624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092545624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:47.495795 run osmo-stp_10.42.42.5(pid=20190): stdout: | (launched: 2022-12-09_09:25:45.455701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:47.615389 run osmo-stp_10.42.42.5(pid=20190): stderr: | [0;m[38;5;43m20221209092545622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092545622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092545622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092545624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092545624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092545624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092545624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:47.758122 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20190): Process ended prematurely: osmo-stp_10.42.42.5(pid=20190) [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:25:47.767238 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:25:47.793899 run osmo-hlr_10.42.42.2(pid=20187): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20187)] 09:25:47.841790 run osmo-hlr_10.42.42.2(pid=20187): stdout: | (launched: 2022-12-09_09:25:44.531135) 09:25:47.891279 run osmo-hlr_10.42.42.2(pid=20187): stderr: | [0;m[1;31m20221209092544703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092544703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092544703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092544703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092544703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092544703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092544720 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092544730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092544730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092544730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:47.961113 run osmo-msc_10.42.42.6(pid=20193): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20193)] 09:25:48.008697 run osmo-msc_10.42.42.6(pid=20193): stdout: | (launched: 2022-12-09_09:25:46.469435) 09:25:48.058109 run osmo-msc_10.42.42.6(pid=20193): stderr: | [0;m[38;5;43m20221209092546894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092546894 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8115130c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092546894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092546894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092546894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092546894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092546896 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092546896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092546897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092546897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:48.107971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Terminating (SIGTERM) 09:25:48.147852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Terminating (SIGTERM) 09:25:48.187693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20192): Terminating (SIGTERM) 09:25:48.227756 --- ParallelTerminationStrategy: PID 20186 died... 09:25:48.246911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20186): Terminated: ok {rc=0} 09:25:48.290913 --- ParallelTerminationStrategy: PID 20189 died... 09:25:48.309766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20189): Terminated: ok {rc=0} 09:25:48.353401 --- ParallelTerminationStrategy: PID 20192 died... 09:25:48.371941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20192): Terminated: ok {rc=0} 09:25:48.456601 bus /sierra_3: Setting Powered False 09:25:49.555211 bus /sierra_3: Setting Powered False 09:25:50.669845 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:25:51.817682 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:51.830461 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:25:51.893435 tst mo_mt_call_osmux.py: using LAC 20504 09:25:52.012620 tst mo_mt_call_osmux.py: using RAC 104 09:25:52.131279 tst mo_mt_call_osmux.py: using CellId 20504 09:25:52.250199 tst mo_mt_call_osmux.py: using BVCI 20505 09:25:52.358040 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:52.369611 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:52.381176 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:52.392422 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:52.403764 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:25:52.414966 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:25:52.533364 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:25:52.655079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:53.149876 run create_hlr_db(pid=20195): Launched 09:25:53.271206 bus /sierra_2: Setting Powered False 09:25:54.334192 run create_hlr_db(pid=20195): Terminated: ok {rc=0} 09:25:54.760336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20197): Launched 09:25:55.058403 run osmo-hlr_10.42.42.2(pid=20198): Launched 09:25:55.171856 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:55.702824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20200): Launched 09:25:56.001730 run osmo-stp_10.42.42.5(pid=20201): Launched 09:25:56.114922 run osmo-msc_10.42.42.6: Starting osmo-msc 09:25:56.656017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20203): Launched 09:25:56.954966 run osmo-msc_10.42.42.6(pid=20204): Launched 09:25:57.122400 run osmo-stp_10.42.42.5(pid=20201): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20201)] 09:25:57.252656 run osmo-stp_10.42.42.5(pid=20201): stdout: | (launched: 2022-12-09_09:25:55.946737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:57.379076 run osmo-stp_10.42.42.5(pid=20201): stderr: | [0;m[38;5;43m20221209092556113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092556113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092556113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092556114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092556114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092556114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092556115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:57.503650 run osmo-stp_10.42.42.5(pid=20201): stdout: | (launched: 2022-12-09_09:25:55.946737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:57.623318 run osmo-stp_10.42.42.5(pid=20201): stderr: | [0;m[38;5;43m20221209092556113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092556113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092556113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092556114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092556114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092556114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092556115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:57.766674 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20201): Process ended prematurely: osmo-stp_10.42.42.5(pid=20201) [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20201)] [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:25:57.775509 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 09:25:57.802167 run osmo-hlr_10.42.42.2(pid=20198): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20198)] 09:25:57.849527 run osmo-hlr_10.42.42.2(pid=20198): stdout: | (launched: 2022-12-09_09:25:55.003368) 09:25:57.898437 run osmo-hlr_10.42.42.2(pid=20198): stderr: | [0;m[1;31m20221209092555173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092555173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092555173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092555173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092555173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092555173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092555186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092555194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092555194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092555194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:57.966649 run osmo-msc_10.42.42.6(pid=20204): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20204)] 09:25:58.013660 run osmo-msc_10.42.42.6(pid=20204): stdout: | (launched: 2022-12-09_09:25:56.899840) 09:25:58.062282 run osmo-msc_10.42.42.6(pid=20204): stderr: | [0;m[38;5;43m20221209092557167 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092557168 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b70530c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092557168 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092557168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092557168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092557168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092557170 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092557170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092557171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092557171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:25:58.111472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20197): Terminating (SIGTERM) 09:25:58.150617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20200): Terminating (SIGTERM) 09:25:58.190166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20203): Terminating (SIGTERM) 09:25:58.229891 --- ParallelTerminationStrategy: PID 20197 died... 09:25:58.248553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20197): Terminated: ok {rc=0} 09:25:58.292392 --- ParallelTerminationStrategy: PID 20200 died... 09:25:58.310900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20200): Terminated: ok {rc=0} 09:25:58.354127 --- ParallelTerminationStrategy: PID 20203 died... 09:25:58.372678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20203): Terminated: ok {rc=0} 09:25:58.457285 bus /sierra_3: Setting Powered False 09:25:59.554990 bus /sierra_3: Setting Powered False 09:26:00.670128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:nanobts+band-1900 --------------------------------------------------------------------- 09:26:01.919238 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:01.925479 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:26:01.951865 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:26:01.981496 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:26:02.071317 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:26:02.096768 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:26:02.126837 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:26:02.714723 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 09:26:02.720234 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:02.731718 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:02.773294 tst emergency_mo_mt_call.py: using LAC 20505 09:26:02.896552 tst emergency_mo_mt_call.py: using RAC 105 09:26:03.018712 tst emergency_mo_mt_call.py: using CellId 20505 09:26:03.145273 tst emergency_mo_mt_call.py: using BVCI 20506 09:26:03.260180 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:03.271535 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:03.282899 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:03.294391 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:03.305899 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:03.317439 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:03.435105 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:03.553653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:04.039203 run create_hlr_db(pid=20210): Launched 09:26:04.159964 bus /sierra_2: Setting Powered False 09:26:05.222139 run create_hlr_db(pid=20210): Terminated: ok {rc=0} 09:26:05.642642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20212): Launched 09:26:05.934887 run osmo-hlr_10.42.42.2(pid=20213): Launched 09:26:06.044855 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:06.547648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20215): Launched 09:26:06.841193 run osmo-stp_10.42.42.5(pid=20216): Launched 09:26:06.962898 tst emergency_mo_mt_call.py: using MSISDN 7131 09:26:07.112271 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:07.641247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20218): Launched 09:26:07.933774 run osmo-msc_10.42.42.6(pid=20219): Launched 09:26:08.096645 run osmo-stp_10.42.42.5(pid=20216): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20216)] 09:26:08.220236 run osmo-stp_10.42.42.5(pid=20216): stdout: | (launched: 2022-12-09_09:26:06.786862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:08.344250 run osmo-stp_10.42.42.5(pid=20216): stderr: | [0;m[38;5;43m20221209092606953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092606953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092606954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092606954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092606954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092606955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092606956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:08.466542 run osmo-stp_10.42.42.5(pid=20216): stdout: | (launched: 2022-12-09_09:26:06.786862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:08.583115 run osmo-stp_10.42.42.5(pid=20216): stderr: | [0;m[38;5;43m20221209092606953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092606953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092606954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092606954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092606954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092606955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092606956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:08.723069 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20216): Process ended prematurely: osmo-stp_10.42.42.5(pid=20216) [trial-2357↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20216)] [trial-2357↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 09:26:08.731548 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 09:26:08.757747 run osmo-hlr_10.42.42.2(pid=20213): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20213)] 09:26:08.804710 run osmo-hlr_10.42.42.2(pid=20213): stdout: | (launched: 2022-12-09_09:26:05.880872) 09:26:08.853386 run osmo-hlr_10.42.42.2(pid=20213): stderr: | [0;m[1;31m20221209092606051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092606051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092606051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092606051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092606051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092606052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092606064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092606075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092606075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092606075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:08.921360 run osmo-msc_10.42.42.6(pid=20219): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20219)] 09:26:08.968435 run osmo-msc_10.42.42.6(pid=20219): stdout: | (launched: 2022-12-09_09:26:07.879644) 09:26:09.017025 run osmo-msc_10.42.42.6(pid=20219): stderr: | [0;m[38;5;43m20221209092608150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092608150 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9aee7bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092608150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092608150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092608150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092608151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092608152 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092608153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092608153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092608153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:09.065746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20212): Terminating (SIGTERM) 09:26:09.105037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20215): Terminating (SIGTERM) 09:26:09.144058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20218): Terminating (SIGTERM) 09:26:09.183367 --- ParallelTerminationStrategy: PID 20212 died... 09:26:09.202343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20212): Terminated: ok {rc=0} 09:26:09.245611 --- ParallelTerminationStrategy: PID 20215 died... 09:26:09.264173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20215): Terminated: ok {rc=0} 09:26:09.307253 --- ParallelTerminationStrategy: PID 20218 died... 09:26:09.325596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20218): Terminated: ok {rc=0} 09:26:09.407487 bus /sierra_3: Setting Powered False 09:26:10.505193 bus /sierra_3: Setting Powered False 09:26:11.620619 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 09:26:12.706147 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:12.718409 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:12.761761 tst emergency_preemptive_call.py: using LAC 20506 09:26:12.878332 tst emergency_preemptive_call.py: using RAC 106 09:26:12.995548 tst emergency_preemptive_call.py: using CellId 20506 09:26:13.112817 tst emergency_preemptive_call.py: using BVCI 20507 09:26:13.220054 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:13.231109 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:13.242191 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:13.253148 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:13.264143 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:26:13.275069 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:13.392463 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:13.510362 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:13.624334 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:13.737428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:14.193253 run create_hlr_db(pid=20221): Launched 09:26:14.312857 bus /sierra_2: Setting Powered False 09:26:15.372661 run create_hlr_db(pid=20221): Terminated: ok {rc=0} 09:26:15.802296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20223): Launched 09:26:16.195098 run osmo-hlr_10.42.42.2(pid=20224): Launched 09:26:16.428151 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:17.069616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20226): Launched 09:26:17.400433 run osmo-stp_10.42.42.5(pid=20227): Launched 09:26:17.532099 tst emergency_preemptive_call.py: using MSISDN 7132 09:26:17.697390 run osmo-msc_10.42.42.6: Starting osmo-msc 09:26:18.266469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20229): Launched 09:26:18.582988 run osmo-msc_10.42.42.6(pid=20230): Launched 09:26:18.759717 run osmo-stp_10.42.42.5(pid=20227): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20227)] 09:26:18.893788 run osmo-stp_10.42.42.5(pid=20227): stdout: | (launched: 2022-12-09_09:26:17.342520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:19.028168 run osmo-stp_10.42.42.5(pid=20227): stderr: | [0;m[38;5;43m20221209092617531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092617531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092617532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092617532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092617533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092617533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092617533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:19.162969 run osmo-stp_10.42.42.5(pid=20227): stdout: | (launched: 2022-12-09_09:26:17.342520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:19.289431 run osmo-stp_10.42.42.5(pid=20227): stderr: | [0;m[38;5;43m20221209092617531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092617531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092617532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092617532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092617533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092617533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092617533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:19.440711 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20227): Process ended prematurely: osmo-stp_10.42.42.5(pid=20227) [trial-2357↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20227)] [trial-2357↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 09:26:19.449819 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 09:26:19.478100 run osmo-hlr_10.42.42.2(pid=20224): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20224)] 09:26:19.528252 run osmo-hlr_10.42.42.2(pid=20224): stdout: | (launched: 2022-12-09_09:26:16.133265) 09:26:19.580125 run osmo-hlr_10.42.42.2(pid=20224): stderr: | [0;m[1;31m20221209092616323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092616323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092616323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092616323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092616323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092616323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092616340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092616355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092616355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092616355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:19.652183 run osmo-msc_10.42.42.6(pid=20230): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20230)] 09:26:19.702149 run osmo-msc_10.42.42.6(pid=20230): stdout: | (launched: 2022-12-09_09:26:18.524666) 09:26:19.753668 run osmo-msc_10.42.42.6(pid=20230): stderr: | [0;m[38;5;43m20221209092618844 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092618844 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f66fe786c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092618844 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092618844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092618844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092618845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092618846 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092618847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092618847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092618847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:26:19.805807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20223): Terminating (SIGTERM) 09:26:19.847717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20226): Terminating (SIGTERM) 09:26:19.889628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20229): Terminating (SIGTERM) 09:26:19.931829 --- ParallelTerminationStrategy: PID 20223 died... 09:26:19.951686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20223): Terminated: ok {rc=0} 09:26:19.998262 --- ParallelTerminationStrategy: PID 20226 died... 09:26:20.017895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20226): Terminated: ok {rc=0} 09:26:20.064056 --- ParallelTerminationStrategy: PID 20229 died... 09:26:20.084009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20229): Terminated: ok {rc=0} 09:26:20.172158 bus /sierra_9: Setting Powered False 09:26:21.270349 bus /sierra_9: Setting Powered False 09:26:22.385637 bus /sierra_8: Setting Powered False 09:26:23.479548 bus /sierra_8: Setting Powered False 09:26:24.593182 bus /sierra_3: Setting Powered False 09:26:25.691546 bus /sierra_3: Setting Powered False 09:26:26.805704 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-1900 --------------------------------------------------------------------- 09:26:28.089883 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:28.095613 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:26:28.122174 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 09:26:28.162351 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:26:28.250651 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:26:28.275890 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 09:26:28.315898 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:26:28.914764 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 09:26:28.968227 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:28.979737 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:29.018776 tst cs_paging_gprs_active.py: using LAC 20507 09:26:29.143490 tst cs_paging_gprs_active.py: using RAC 107 09:26:29.267814 tst cs_paging_gprs_active.py: using CellId 20507 09:26:29.395238 tst cs_paging_gprs_active.py: using BVCI 20508 09:26:29.513500 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.524811 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.535875 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.547121 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.558543 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.569962 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.581595 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.592779 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:29.604414 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:29.723527 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:29.839333 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:26:30.041580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:30.343774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20235): Launched 09:26:30.605860 run iperf3-srv_10.42.42.10(pid=20236): Launched 09:26:30.718031 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:26:30.939332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:31.261662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20237): Launched 09:26:31.536344 run iperf3-srv_10.42.42.10(pid=20238): Launched 09:26:31.715880 tst cs_paging_gprs_active.py:38: start network... 09:26:31.939345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:32.413250 run create_hlr_db(pid=20239): Launched 09:26:32.537141 bus /sierra_2: Setting Powered False 09:26:33.596860 run create_hlr_db(pid=20239): Terminated: ok {rc=0} 09:26:34.034871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20241): Launched 09:26:34.358345 run osmo-hlr_10.42.42.2(pid=20242): Launched 09:26:34.480724 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:35.039429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20244): Launched 09:26:35.363258 run osmo-stp_10.42.42.5(pid=20245): Launched 09:26:35.486511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:26:36.044202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20247): Launched 09:26:36.168312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:26:36.441748 run patchelf(pid=20248): Launched 09:26:36.622260 run osmo-stp_10.42.42.5(pid=20245): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20245)] 09:26:36.758695 run osmo-stp_10.42.42.5(pid=20245): stdout: | (launched: 2022-12-09_09:26:35.304143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:36.897233 run osmo-stp_10.42.42.5(pid=20245): stderr: | [0;m[38;5;43m20221209092635491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092635491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092635491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092635492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092635492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092635492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092635492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:37.035530 run osmo-stp_10.42.42.5(pid=20245): stdout: | (launched: 2022-12-09_09:26:35.304143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:37.168827 run osmo-stp_10.42.42.5(pid=20245): stderr: | [0;m[38;5;43m20221209092635491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092635491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092635491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092635492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092635492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092635492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092635492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:37.326161 run patchelf(pid=20248): Terminating (SIGINT) 09:26:37.507281 run patchelf(pid=20248): Terminated: ok {rc=0} 09:26:37.637555 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20245): Process ended prematurely: osmo-stp_10.42.42.5(pid=20245) [trial-2357↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20245)] [trial-2357↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 09:26:37.647602 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:26:37.676320 run osmo-hlr_10.42.42.2(pid=20242): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20242)] 09:26:37.726266 run osmo-hlr_10.42.42.2(pid=20242): stdout: | (launched: 2022-12-09_09:26:34.298731) 09:26:37.777881 run osmo-hlr_10.42.42.2(pid=20242): stderr: | [0;m[1;31m20221209092634494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092634494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092634494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092634494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092634494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092634494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092634507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092634515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092634515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092634515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:37.830098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20235): Terminating (SIGTERM) 09:26:37.872005 run iperf3-srv_10.42.42.10(pid=20236): Terminating (SIGTERM) 09:26:37.913796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20237): Terminating (SIGTERM) 09:26:37.955629 run iperf3-srv_10.42.42.10(pid=20238): Terminating (SIGTERM) 09:26:37.997494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20241): Terminating (SIGTERM) 09:26:38.039493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20244): Terminating (SIGTERM) 09:26:38.081644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20247): Terminating (SIGTERM) 09:26:38.123844 --- ParallelTerminationStrategy: PID 20235 died... 09:26:38.143857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20235): Terminated: ok {rc=0} 09:26:38.190066 --- ParallelTerminationStrategy: PID 20236 died... 09:26:38.209441 run iperf3-srv_10.42.42.10(pid=20236): Terminated {rc=256} 09:26:38.255380 --- ParallelTerminationStrategy: PID 20237 died... 09:26:38.274733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20237): Terminated: ok {rc=0} 09:26:38.320666 --- ParallelTerminationStrategy: PID 20238 died... 09:26:38.340056 run iperf3-srv_10.42.42.10(pid=20238): Terminated {rc=256} 09:26:38.385816 --- ParallelTerminationStrategy: PID 20241 died... 09:26:38.405301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20241): Terminated: ok {rc=0} 09:26:38.451097 --- ParallelTerminationStrategy: PID 20244 died... 09:26:38.470517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20244): Terminated: ok {rc=0} 09:26:38.516414 --- ParallelTerminationStrategy: PID 20247 died... 09:26:38.535828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20247): Terminated: ok {rc=0} 09:26:38.622809 bus /gobi_0: Setting Powered False 09:26:39.721266 bus /gobi_0: Setting Powered False 09:26:40.839128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 09:26:41.984538 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:41.995919 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:42.040549 tst iperf3.py: using LAC 20508 09:26:42.167449 tst iperf3.py: using RAC 108 09:26:42.292476 tst iperf3.py: using CellId 20508 09:26:42.416619 tst iperf3.py: using BVCI 20509 09:26:42.533687 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.545289 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.556646 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.568395 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.579943 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.591325 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.603114 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.614583 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:42.626263 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:42.747355 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:26:42.950596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:43.252462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20249): Launched 09:26:43.514381 run iperf3-srv_10.42.42.10(pid=20250): Launched 09:26:43.627521 tst iperf3.py:8: start network... 09:26:43.828786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:44.297435 run create_hlr_db(pid=20251): Launched 09:26:44.421106 bus /gobi_6: Setting Powered False 09:26:45.481784 run create_hlr_db(pid=20251): Terminated: ok {rc=0} 09:26:45.941183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20253): Launched 09:26:46.286433 run osmo-hlr_10.42.42.2(pid=20254): Launched 09:26:46.505160 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:47.169719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20256): Launched 09:26:47.501385 run osmo-stp_10.42.42.5(pid=20257): Launched 09:26:47.626282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:26:48.189604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20259): Launched 09:26:48.313526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:26:48.588463 run patchelf(pid=20260): Launched 09:26:48.768427 run osmo-stp_10.42.42.5(pid=20257): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20257)] 09:26:48.905184 run osmo-stp_10.42.42.5(pid=20257): stdout: | (launched: 2022-12-09_09:26:47.442458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:49.043457 run osmo-stp_10.42.42.5(pid=20257): stderr: | [0;m[38;5;43m20221209092647628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092647628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092647628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092647629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092647629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092647629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092647629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:49.182929 run osmo-stp_10.42.42.5(pid=20257): stdout: | (launched: 2022-12-09_09:26:47.442458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:49.315817 run osmo-stp_10.42.42.5(pid=20257): stderr: | [0;m[38;5;43m20221209092647628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092647628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092647628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092647629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092647629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092647629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092647629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:49.473290 run patchelf(pid=20260): Terminating (SIGINT) 09:26:49.654279 run patchelf(pid=20260): Terminated: ok {rc=0} 09:26:49.784888 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20257): Process ended prematurely: osmo-stp_10.42.42.5(pid=20257) [trial-2357↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20257)] [trial-2357↪gprs:nanobts+band-1900↪iperf3.py:8] 09:26:49.795217 tst iperf3.py:8: Test FAILED (7.8 sec) 09:26:49.824441 run osmo-hlr_10.42.42.2(pid=20254): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20254)] 09:26:49.874429 run osmo-hlr_10.42.42.2(pid=20254): stdout: | (launched: 2022-12-09_09:26:46.221622) 09:26:49.926039 run osmo-hlr_10.42.42.2(pid=20254): stderr: | [0;m[1;31m20221209092646419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092646419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092646419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092646419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092646419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092646419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092646435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092646451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092646452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092646452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:49.978543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20249): Terminating (SIGTERM) 09:26:50.020738 run iperf3-srv_10.42.42.10(pid=20250): Terminating (SIGTERM) 09:26:50.062728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20253): Terminating (SIGTERM) 09:26:50.105307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20256): Terminating (SIGTERM) 09:26:50.147478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20259): Terminating (SIGTERM) 09:26:50.189888 --- ParallelTerminationStrategy: PID 20249 died... 09:26:50.209814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20249): Terminated: ok {rc=0} 09:26:50.256416 --- ParallelTerminationStrategy: PID 20250 died... 09:26:50.275971 run iperf3-srv_10.42.42.10(pid=20250): Terminated {rc=256} 09:26:50.322281 --- ParallelTerminationStrategy: PID 20253 died... 09:26:50.341912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20253): Terminated: ok {rc=0} 09:26:50.388316 --- ParallelTerminationStrategy: PID 20256 died... 09:26:50.408034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20256): Terminated: ok {rc=0} 09:26:50.454582 --- ParallelTerminationStrategy: PID 20259 died... 09:26:50.474197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20259): Terminated: ok {rc=0} 09:26:50.562010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 09:26:51.708762 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:51.720154 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:26:51.758298 tst iperf3m4.py: using LAC 20509 09:26:51.877365 tst iperf3m4.py: using RAC 109 09:26:51.994816 tst iperf3m4.py: using CellId 20509 09:26:52.114520 tst iperf3m4.py: using BVCI 20510 09:26:52.225263 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.236042 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.246990 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.257729 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.268297 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.278891 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.289709 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.300236 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:26:52.311036 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:52.430877 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:52.552278 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:52.672617 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:26:52.789905 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:26:52.993055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:53.298365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20261): Launched 09:26:53.562057 run iperf3-srv_10.42.42.10(pid=20262): Launched 09:26:53.675336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:26:53.876425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:54.180352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20263): Launched 09:26:54.443729 run iperf3-srv_10.42.42.10(pid=20264): Launched 09:26:54.557168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:26:54.758166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:55.063117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20265): Launched 09:26:55.326066 run iperf3-srv_10.42.42.10(pid=20266): Launched 09:26:55.438657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:26:55.639878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:55.944150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20267): Launched 09:26:56.207591 run iperf3-srv_10.42.42.10(pid=20268): Launched 09:26:56.320030 tst iperf3m4.py:8: start network... 09:26:56.521892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:56.990181 run create_hlr_db(pid=20269): Launched 09:26:57.112739 bus /gobi_6: Setting Powered False 09:26:58.172741 run create_hlr_db(pid=20269): Terminated: ok {rc=0} 09:26:58.613057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Launched 09:26:58.936303 run osmo-hlr_10.42.42.2(pid=20272): Launched 09:26:59.059821 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:59.620717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Launched 09:26:59.943734 run osmo-stp_10.42.42.5(pid=20275): Launched 09:27:00.067105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:27:00.625742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20277): Launched 09:27:00.749348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:27:01.034006 run patchelf(pid=20278): Launched 09:27:01.250743 run osmo-stp_10.42.42.5(pid=20275): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] 09:27:01.381978 run osmo-stp_10.42.42.5(pid=20275): stdout: | (launched: 2022-12-09_09:26:59.884534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:01.516536 run osmo-stp_10.42.42.5(pid=20275): stderr: | [0;m[38;5;43m20221209092700072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092700072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092700072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092700073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092700073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092700073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092700073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:01.651711 run osmo-stp_10.42.42.5(pid=20275): stdout: | (launched: 2022-12-09_09:26:59.884534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:01.779766 run osmo-stp_10.42.42.5(pid=20275): stderr: | [0;m[38;5;43m20221209092700072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092700072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092700072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092700073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092700073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092700073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092700073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:01.933188 run patchelf(pid=20278): Terminating (SIGINT) 09:27:02.108511 run patchelf(pid=20278): Terminated: ok {rc=0} 09:27:02.233800 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20275): Process ended prematurely: osmo-stp_10.42.42.5(pid=20275) [trial-2357↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] [trial-2357↪gprs:nanobts+band-1900↪iperf3m4.py:8] 09:27:02.244847 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:27:02.273357 run osmo-hlr_10.42.42.2(pid=20272): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20272)] 09:27:02.321760 run osmo-hlr_10.42.42.2(pid=20272): stdout: | (launched: 2022-12-09_09:26:58.877211) 09:27:02.371500 run osmo-hlr_10.42.42.2(pid=20272): stderr: | [0;m[1;31m20221209092659073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092659073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092659073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092659073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092659074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092659074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092659088 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092659098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092659098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092659098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:02.420922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20261): Terminating (SIGTERM) 09:27:02.460739 run iperf3-srv_10.42.42.10(pid=20262): Terminating (SIGTERM) 09:27:02.500212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20263): Terminating (SIGTERM) 09:27:02.539761 run iperf3-srv_10.42.42.10(pid=20264): Terminating (SIGTERM) 09:27:02.579120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20265): Terminating (SIGTERM) 09:27:02.618636 run iperf3-srv_10.42.42.10(pid=20266): Terminating (SIGTERM) 09:27:02.657772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20267): Terminating (SIGTERM) 09:27:02.697113 run iperf3-srv_10.42.42.10(pid=20268): Terminating (SIGTERM) 09:27:02.736321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Terminating (SIGTERM) 09:27:02.775507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Terminating (SIGTERM) 09:27:02.814788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20277): Terminating (SIGTERM) 09:27:02.854567 --- ParallelTerminationStrategy: PID 20261 died... 09:27:02.873545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20261): Terminated: ok {rc=0} 09:27:02.917333 --- ParallelTerminationStrategy: PID 20262 died... 09:27:02.936074 run iperf3-srv_10.42.42.10(pid=20262): Terminated {rc=256} 09:27:02.979749 --- ParallelTerminationStrategy: PID 20263 died... 09:27:02.998559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20263): Terminated: ok {rc=0} 09:27:03.042602 --- ParallelTerminationStrategy: PID 20264 died... 09:27:03.061335 run iperf3-srv_10.42.42.10(pid=20264): Terminated {rc=256} 09:27:03.106479 --- ParallelTerminationStrategy: PID 20265 died... 09:27:03.125103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20265): Terminated: ok {rc=0} 09:27:03.168571 --- ParallelTerminationStrategy: PID 20266 died... 09:27:03.187129 run iperf3-srv_10.42.42.10(pid=20266): Terminated {rc=256} 09:27:03.230400 --- ParallelTerminationStrategy: PID 20267 died... 09:27:03.249150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20267): Terminated: ok {rc=0} 09:27:03.292553 --- ParallelTerminationStrategy: PID 20268 died... 09:27:03.311188 run iperf3-srv_10.42.42.10(pid=20268): Terminated {rc=256} 09:27:03.354622 --- ParallelTerminationStrategy: PID 20271 died... 09:27:03.373256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20271): Terminated: ok {rc=0} 09:27:03.416597 --- ParallelTerminationStrategy: PID 20274 died... 09:27:03.435295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20274): Terminated: ok {rc=0} 09:27:03.479194 --- ParallelTerminationStrategy: PID 20277 died... 09:27:03.497844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20277): Terminated: ok {rc=0} 09:27:03.582321 bus /gobi_4: Setting Powered False 09:27:04.680567 bus /gobi_4: Setting Powered False 09:27:05.797807 bus /gobi_1: Setting Powered False 09:27:06.896103 bus /gobi_1: Setting Powered False 09:27:08.011490 bus /gobi_0: Setting Powered False 09:27:09.109120 bus /gobi_0: Setting Powered False 09:27:10.224517 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 09:27:11.326624 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.338223 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:27:11.377173 tst ping.py: using LAC 20510 09:27:11.492718 tst ping.py: using RAC 110 09:27:11.617628 tst ping.py: using CellId 20510 09:27:11.734007 tst ping.py: using BVCI 20511 09:27:11.841055 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.852046 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.863033 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.873848 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.884609 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.895367 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.906171 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:11.916894 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:27:12.029711 tst ping.py:19: start network... 09:27:12.226540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:12.683626 run create_hlr_db(pid=20280): Launched 09:27:12.805132 bus /gobi_6: Setting Powered False 09:27:13.862844 run create_hlr_db(pid=20280): Terminated: ok {rc=0} 09:27:14.295690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20282): Launched 09:27:14.595169 run osmo-hlr_10.42.42.2(pid=20283): Launched 09:27:14.706685 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:15.221314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20285): Launched 09:27:15.517024 run osmo-stp_10.42.42.5(pid=20286): Launched 09:27:15.629048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:27:16.151971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20288): Launched 09:27:16.288589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:27:16.572369 run patchelf(pid=20289): Launched 09:27:16.765261 run osmo-stp_10.42.42.5(pid=20286): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20286)] 09:27:16.905755 run osmo-stp_10.42.42.5(pid=20286): stdout: | (launched: 2022-12-09_09:27:15.461972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:17.048570 run osmo-stp_10.42.42.5(pid=20286): stderr: | [0;m[38;5;43m20221209092715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092715630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:17.189766 run osmo-stp_10.42.42.5(pid=20286): stdout: | (launched: 2022-12-09_09:27:15.461972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:17.321653 run osmo-stp_10.42.42.5(pid=20286): stderr: | [0;m[38;5;43m20221209092715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092715629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092715630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092715630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:17.475835 run patchelf(pid=20289): Terminating (SIGINT) 09:27:17.654517 run patchelf(pid=20289): Terminated: ok {rc=0} 09:27:17.783028 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20286): Process ended prematurely: osmo-stp_10.42.42.5(pid=20286) [trial-2357↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20286)] [trial-2357↪gprs:nanobts+band-1900↪ping.py:22] 09:27:17.792875 tst ping.py:22: Test FAILED (6.5 sec) 09:27:17.821877 run osmo-hlr_10.42.42.2(pid=20283): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20283)] 09:27:17.872210 run osmo-hlr_10.42.42.2(pid=20283): stdout: | (launched: 2022-12-09_09:27:14.540129) 09:27:17.923976 run osmo-hlr_10.42.42.2(pid=20283): stderr: | [0;m[1;31m20221209092714713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092714713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092714713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092714714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092714714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092714714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092714726 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092714735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092714735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092714735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:17.975741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20282): Terminating (SIGTERM) 09:27:18.017611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20285): Terminating (SIGTERM) 09:27:18.059552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20288): Terminating (SIGTERM) 09:27:18.102040 --- ParallelTerminationStrategy: PID 20282 died... 09:27:18.121988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20282): Terminated: ok {rc=0} 09:27:18.168615 --- ParallelTerminationStrategy: PID 20285 died... 09:27:18.188355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20285): Terminated: ok {rc=0} 09:27:18.234844 --- ParallelTerminationStrategy: PID 20288 died... 09:27:18.254806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20288): Terminated: ok {rc=0} 09:27:18.341995 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 09:27:19.430164 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:19.442853 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:27:19.484558 tst ping_idle_ping.py: using LAC 20511 09:27:19.610107 tst ping_idle_ping.py: using RAC 111 09:27:19.737031 tst ping_idle_ping.py: using CellId 20511 09:27:19.861034 tst ping_idle_ping.py: using BVCI 20512 09:27:19.976220 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:19.987863 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:19.999124 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:20.010735 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:20.022083 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:20.033439 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:20.044879 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:27:20.056478 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:27:20.174671 tst ping_idle_ping.py:24: start network... 09:27:20.373719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:20.837244 run create_hlr_db(pid=20290): Launched 09:27:20.959374 bus /gobi_6: Setting Powered False 09:27:22.018806 run create_hlr_db(pid=20290): Terminated: ok {rc=0} 09:27:22.434484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20292): Launched 09:27:22.731577 run osmo-hlr_10.42.42.2(pid=20293): Launched 09:27:22.843972 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:23.374719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20295): Launched 09:27:23.671397 run osmo-stp_10.42.42.5(pid=20296): Launched 09:27:23.783943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:27:24.295013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20298): Launched 09:27:24.407727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:27:24.658762 run patchelf(pid=20299): Launched 09:27:24.823344 run osmo-stp_10.42.42.5(pid=20296): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20296)] 09:27:24.948633 run osmo-stp_10.42.42.5(pid=20296): stdout: | (launched: 2022-12-09_09:27:23.615863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:25.075523 run osmo-stp_10.42.42.5(pid=20296): stderr: | [0;m[38;5;43m20221209092723781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092723781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092723782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092723782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092723783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092723783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092723783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:25.202494 run osmo-stp_10.42.42.5(pid=20296): stdout: | (launched: 2022-12-09_09:27:23.615863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:25.324701 run osmo-stp_10.42.42.5(pid=20296): stderr: | [0;m[38;5;43m20221209092723781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092723781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092723782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092723782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092723783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092723783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092723783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:25.468868 run patchelf(pid=20299): Terminating (SIGINT) 09:27:25.634877 run patchelf(pid=20299): Terminated: ok {rc=0} 09:27:25.754540 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20296): Process ended prematurely: osmo-stp_10.42.42.5(pid=20296) [trial-2357↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20296)] [trial-2357↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 09:27:25.763358 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:27:25.789915 run osmo-hlr_10.42.42.2(pid=20293): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20293)] 09:27:25.837116 run osmo-hlr_10.42.42.2(pid=20293): stdout: | (launched: 2022-12-09_09:27:22.676718) 09:27:25.885580 run osmo-hlr_10.42.42.2(pid=20293): stderr: | [0;m[1;31m20221209092722847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092722847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092722848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092722848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092722848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092722848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092722860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092722869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092722869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092722869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:25.934360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20292): Terminating (SIGTERM) 09:27:25.973753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20295): Terminating (SIGTERM) 09:27:26.012919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20298): Terminating (SIGTERM) 09:27:26.052644 --- ParallelTerminationStrategy: PID 20292 died... 09:27:26.071621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20292): Terminated: ok {rc=0} 09:27:26.114916 --- ParallelTerminationStrategy: PID 20295 died... 09:27:26.133326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20295): Terminated: ok {rc=0} 09:27:26.176492 --- ParallelTerminationStrategy: PID 20298 died... 09:27:26.194979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20298): Terminated: ok {rc=0} 09:27:26.277698 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 09:27:27.571910 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:27.577982 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:27:27.601788 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:27:27.640441 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:27:27.729795 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:27:27.754054 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:27:27.792441 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:27:28.388279 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:27:28.436423 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:28.447550 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:27:28.488251 tst cs_paging_gprs_active.py: using LAC 20512 09:27:28.607282 tst cs_paging_gprs_active.py: using RAC 112 09:27:28.727397 tst cs_paging_gprs_active.py: using CellId 20512 09:27:28.846526 tst cs_paging_gprs_active.py: using BVCI 20513 09:27:28.955333 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:28.966499 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:28.977395 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:28.988230 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:28.999090 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:29.009985 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:29.020925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:29.031784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:29.042840 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:27:29.162062 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:27:29.283459 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:27:29.501955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:27:29.825859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20305): Launched 09:27:30.106475 run iperf3-srv_10.42.42.10(pid=20306): Launched 09:27:30.226803 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:27:30.443878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:27:30.767536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20307): Launched 09:27:31.053040 run iperf3-srv_10.42.42.10(pid=20308): Launched 09:27:31.185388 tst cs_paging_gprs_active.py:38: start network... 09:27:31.407772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:31.922442 run create_hlr_db(pid=20309): Launched 09:27:32.088799 bus /gobi_6: Setting Powered False 09:27:33.153072 run create_hlr_db(pid=20309): Terminated: ok {rc=0} 09:27:33.585670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20311): Launched 09:27:33.887244 run osmo-hlr_10.42.42.2(pid=20312): Launched 09:27:34.001258 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:34.534192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20314): Launched 09:27:34.835280 run osmo-stp_10.42.42.5(pid=20315): Launched 09:27:34.948630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:27:35.469830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20317): Launched 09:27:35.584777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:27:35.840376 run patchelf(pid=20322): Launched 09:27:36.008000 run osmo-stp_10.42.42.5(pid=20315): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20315)] 09:27:36.136179 run osmo-stp_10.42.42.5(pid=20315): stdout: | (launched: 2022-12-09_09:27:34.779632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:36.265538 run osmo-stp_10.42.42.5(pid=20315): stderr: | [0;m[38;5;43m20221209092734948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092734948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092734948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092734949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092734949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092734949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092734949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:36.394939 run osmo-stp_10.42.42.5(pid=20315): stdout: | (launched: 2022-12-09_09:27:34.779632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:36.518772 run osmo-stp_10.42.42.5(pid=20315): stderr: | [0;m[38;5;43m20221209092734948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092734948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092734948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092734949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092734949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092734949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092734949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:36.665398 run patchelf(pid=20322): Terminating (SIGINT) 09:27:36.834375 run patchelf(pid=20322): Terminated: ok {rc=0} 09:27:36.955971 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20315): Process ended prematurely: osmo-stp_10.42.42.5(pid=20315) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20315)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:27:36.965625 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:27:36.992521 run osmo-hlr_10.42.42.2(pid=20312): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20312)] 09:27:37.039987 run osmo-hlr_10.42.42.2(pid=20312): stdout: | (launched: 2022-12-09_09:27:33.831665) 09:27:37.088709 run osmo-hlr_10.42.42.2(pid=20312): stderr: | [0;m[1;31m20221209092734005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092734005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092734005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092734005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092734005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092734005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092734017 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092734027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092734027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092734027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:37.138099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20305): Terminating (SIGTERM) 09:27:37.177570 run iperf3-srv_10.42.42.10(pid=20306): Terminating (SIGTERM) 09:27:37.216882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20307): Terminating (SIGTERM) 09:27:37.256163 run iperf3-srv_10.42.42.10(pid=20308): Terminating (SIGTERM) 09:27:37.295404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20311): Terminating (SIGTERM) 09:27:37.334780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20314): Terminating (SIGTERM) 09:27:37.374467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20317): Terminating (SIGTERM) 09:27:37.414290 --- ParallelTerminationStrategy: PID 20305 died... 09:27:37.433247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20305): Terminated: ok {rc=0} 09:27:37.476728 --- ParallelTerminationStrategy: PID 20306 died... 09:27:37.495092 run iperf3-srv_10.42.42.10(pid=20306): Terminated {rc=256} 09:27:37.538270 --- ParallelTerminationStrategy: PID 20307 died... 09:27:37.556656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20307): Terminated: ok {rc=0} 09:27:37.599721 --- ParallelTerminationStrategy: PID 20308 died... 09:27:37.618052 run iperf3-srv_10.42.42.10(pid=20308): Terminated {rc=256} 09:27:37.661183 --- ParallelTerminationStrategy: PID 20311 died... 09:27:37.679606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20311): Terminated: ok {rc=0} 09:27:37.722909 --- ParallelTerminationStrategy: PID 20314 died... 09:27:37.741336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20314): Terminated: ok {rc=0} 09:27:37.784649 --- ParallelTerminationStrategy: PID 20317 died... 09:27:37.803416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20317): Terminated: ok {rc=0} 09:27:37.888578 bus /gobi_0: Setting Powered False 09:27:38.988594 bus /gobi_0: Setting Powered False 09:27:40.104263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:27:41.251720 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.263864 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:27:41.308659 tst iperf3.py: using LAC 20513 09:27:41.436379 tst iperf3.py: using RAC 113 09:27:41.555223 tst iperf3.py: using CellId 20513 09:27:41.680478 tst iperf3.py: using BVCI 20514 09:27:41.790529 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.801856 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.812802 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.823777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.834737 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.845491 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.856448 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.867406 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:41.878362 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:27:41.995968 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:27:42.214826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:27:42.539429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20323): Launched 09:27:42.820856 run iperf3-srv_10.42.42.10(pid=20324): Launched 09:27:42.942370 tst iperf3.py:8: start network... 09:27:43.160443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:43.662348 run create_hlr_db(pid=20325): Launched 09:27:43.784804 bus /gobi_6: Setting Powered False 09:27:44.848510 run create_hlr_db(pid=20325): Terminated: ok {rc=0} 09:27:45.278557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20327): Launched 09:27:45.580724 run osmo-hlr_10.42.42.2(pid=20328): Launched 09:27:45.696596 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:46.273669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20330): Launched 09:27:46.606138 run osmo-stp_10.42.42.5(pid=20331): Launched 09:27:46.806474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:27:47.436830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20333): Launched 09:27:47.552158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:27:47.808436 run patchelf(pid=20334): Launched 09:27:47.976157 run osmo-stp_10.42.42.5(pid=20331): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20331)] 09:27:48.104568 run osmo-stp_10.42.42.5(pid=20331): stdout: | (launched: 2022-12-09_09:27:46.541791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:48.234218 run osmo-stp_10.42.42.5(pid=20331): stderr: | [0;m[38;5;43m20221209092746852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092746856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092746856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092746857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092746857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092746857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092746857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:48.364042 run osmo-stp_10.42.42.5(pid=20331): stdout: | (launched: 2022-12-09_09:27:46.541791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:48.488188 run osmo-stp_10.42.42.5(pid=20331): stderr: | [0;m[38;5;43m20221209092746852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092746856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092746856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092746857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092746857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092746857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092746857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:48.635049 run patchelf(pid=20334): Terminating (SIGINT) 09:27:48.805242 run patchelf(pid=20334): Terminated: ok {rc=0} 09:27:48.927320 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20331): Process ended prematurely: osmo-stp_10.42.42.5(pid=20331) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20331)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 09:27:48.936742 tst iperf3.py:8: Test FAILED (7.7 sec) 09:27:48.964113 run osmo-hlr_10.42.42.2(pid=20328): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20328)] 09:27:49.011973 run osmo-hlr_10.42.42.2(pid=20328): stdout: | (launched: 2022-12-09_09:27:45.525071) 09:27:49.061374 run osmo-hlr_10.42.42.2(pid=20328): stderr: | [0;m[1;31m20221209092745700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092745700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092745700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092745700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092745700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092745700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092745712 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092745721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092745721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092745721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:49.111412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20323): Terminating (SIGTERM) 09:27:49.151504 run iperf3-srv_10.42.42.10(pid=20324): Terminating (SIGTERM) 09:27:49.191028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20327): Terminating (SIGTERM) 09:27:49.230723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20330): Terminating (SIGTERM) 09:27:49.270106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20333): Terminating (SIGTERM) 09:27:49.309872 --- ParallelTerminationStrategy: PID 20323 died... 09:27:49.328758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20323): Terminated: ok {rc=0} 09:27:49.373130 --- ParallelTerminationStrategy: PID 20324 died... 09:27:49.391876 run iperf3-srv_10.42.42.10(pid=20324): Terminated {rc=256} 09:27:49.435737 --- ParallelTerminationStrategy: PID 20327 died... 09:27:49.455016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20327): Terminated: ok {rc=0} 09:27:49.498721 --- ParallelTerminationStrategy: PID 20330 died... 09:27:49.517257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20330): Terminated: ok {rc=0} 09:27:49.560709 --- ParallelTerminationStrategy: PID 20333 died... 09:27:49.579264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20333): Terminated: ok {rc=0} 09:27:49.663339 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:27:50.809763 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:50.821430 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:27:50.862312 tst iperf3m4.py: using LAC 20514 09:27:50.982758 tst iperf3m4.py: using RAC 114 09:27:51.103635 tst iperf3m4.py: using CellId 20514 09:27:51.227774 tst iperf3m4.py: using BVCI 20515 09:27:51.339356 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.350564 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.361624 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.372510 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.383364 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.394223 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.405289 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.416093 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:27:51.427160 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:27:51.547803 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:27:51.668236 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:27:51.790793 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:27:51.911058 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:27:52.116758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:27:52.422576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20335): Launched 09:27:52.687414 run iperf3-srv_10.42.42.10(pid=20336): Launched 09:27:52.800678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:27:53.003446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:27:53.307816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20337): Launched 09:27:53.572151 run iperf3-srv_10.42.42.10(pid=20338): Launched 09:27:53.685354 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:27:53.887519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:27:54.190367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20339): Launched 09:27:54.453275 run iperf3-srv_10.42.42.10(pid=20340): Launched 09:27:54.565966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:27:54.767687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:27:55.071809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20341): Launched 09:27:55.334911 run iperf3-srv_10.42.42.10(pid=20342): Launched 09:27:55.447421 tst iperf3m4.py:8: start network... 09:27:55.650018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:56.118763 run create_hlr_db(pid=20343): Launched 09:27:56.241122 bus /gobi_6: Setting Powered False 09:27:57.300893 run create_hlr_db(pid=20343): Terminated: ok {rc=0} 09:27:57.722981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20345): Launched 09:27:58.025106 run osmo-hlr_10.42.42.2(pid=20346): Launched 09:27:58.141138 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:58.667182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20348): Launched 09:27:58.968314 run osmo-stp_10.42.42.5(pid=20349): Launched 09:27:59.083050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:27:59.604387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20351): Launched 09:27:59.719867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:27:59.974538 run patchelf(pid=20352): Launched 09:28:00.141723 run osmo-stp_10.42.42.5(pid=20349): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20349)] 09:28:00.268659 run osmo-stp_10.42.42.5(pid=20349): stdout: | (launched: 2022-12-09_09:27:58.912654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:00.397414 run osmo-stp_10.42.42.5(pid=20349): stderr: | [0;m[38;5;43m20221209092759080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092759080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092759081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092759081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092759082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092759082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092759082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:00.525756 run osmo-stp_10.42.42.5(pid=20349): stdout: | (launched: 2022-12-09_09:27:58.912654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:00.648792 run osmo-stp_10.42.42.5(pid=20349): stderr: | [0;m[38;5;43m20221209092759080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092759080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092759081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092759081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092759082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092759082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092759082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:00.794562 run patchelf(pid=20352): Terminating (SIGINT) 09:28:00.970227 run patchelf(pid=20352): Terminated: ok {rc=0} 09:28:01.094470 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20349): Process ended prematurely: osmo-stp_10.42.42.5(pid=20349) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20349)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 09:28:01.104502 tst iperf3m4.py:8: Test FAILED (10.3 sec) 09:28:01.133394 run osmo-hlr_10.42.42.2(pid=20346): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20346)] 09:28:01.181846 run osmo-hlr_10.42.42.2(pid=20346): stdout: | (launched: 2022-12-09_09:27:57.968880) 09:28:01.231897 run osmo-hlr_10.42.42.2(pid=20346): stderr: | [0;m[1;31m20221209092758144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092758144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092758144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092758144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092758144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092758144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092758156 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092758165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092758165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092758165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:01.282949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20335): Terminating (SIGTERM) 09:28:01.322950 run iperf3-srv_10.42.42.10(pid=20336): Terminating (SIGTERM) 09:28:01.363375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20337): Terminating (SIGTERM) 09:28:01.404000 run iperf3-srv_10.42.42.10(pid=20338): Terminating (SIGTERM) 09:28:01.443709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20339): Terminating (SIGTERM) 09:28:01.483408 run iperf3-srv_10.42.42.10(pid=20340): Terminating (SIGTERM) 09:28:01.525053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20341): Terminating (SIGTERM) 09:28:01.566195 run iperf3-srv_10.42.42.10(pid=20342): Terminating (SIGTERM) 09:28:01.606497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20345): Terminating (SIGTERM) 09:28:01.646721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20348): Terminating (SIGTERM) 09:28:01.687968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20351): Terminating (SIGTERM) 09:28:01.728342 --- ParallelTerminationStrategy: PID 20335 died... 09:28:01.747408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20335): Terminated: ok {rc=0} 09:28:01.791259 --- ParallelTerminationStrategy: PID 20336 died... 09:28:01.810133 run iperf3-srv_10.42.42.10(pid=20336): Terminated {rc=256} 09:28:01.853965 --- ParallelTerminationStrategy: PID 20337 died... 09:28:01.873314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20337): Terminated: ok {rc=0} 09:28:01.918863 --- ParallelTerminationStrategy: PID 20338 died... 09:28:01.938284 run iperf3-srv_10.42.42.10(pid=20338): Terminated {rc=256} 09:28:01.983239 --- ParallelTerminationStrategy: PID 20339 died... 09:28:02.002545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20339): Terminated: ok {rc=0} 09:28:02.046319 --- ParallelTerminationStrategy: PID 20340 died... 09:28:02.065127 run iperf3-srv_10.42.42.10(pid=20340): Terminated {rc=256} 09:28:02.108811 --- ParallelTerminationStrategy: PID 20341 died... 09:28:02.127686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20341): Terminated: ok {rc=0} 09:28:02.171299 --- ParallelTerminationStrategy: PID 20342 died... 09:28:02.190034 run iperf3-srv_10.42.42.10(pid=20342): Terminated {rc=256} 09:28:02.233470 --- ParallelTerminationStrategy: PID 20345 died... 09:28:02.252144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20345): Terminated: ok {rc=0} 09:28:02.295712 --- ParallelTerminationStrategy: PID 20348 died... 09:28:02.313988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20348): Terminated: ok {rc=0} 09:28:02.356902 --- ParallelTerminationStrategy: PID 20351 died... 09:28:02.375107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20351): Terminated: ok {rc=0} 09:28:02.457880 bus /gobi_4: Setting Powered False 09:28:03.553692 bus /gobi_4: Setting Powered False 09:28:04.668176 bus /gobi_1: Setting Powered False 09:28:05.766230 bus /gobi_1: Setting Powered False 09:28:06.879872 bus /gobi_0: Setting Powered False 09:28:07.978412 bus /gobi_0: Setting Powered False 09:28:09.091471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 09:28:10.192373 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.204668 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:28:10.248260 tst ping.py: using LAC 20515 09:28:10.373320 tst ping.py: using RAC 115 09:28:10.499531 tst ping.py: using CellId 20515 09:28:10.618353 tst ping.py: using BVCI 20516 09:28:10.725471 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.736893 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.748003 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.759067 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.770065 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.780799 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.791921 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:10.802801 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:28:10.922740 tst ping.py:19: start network... 09:28:11.137245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:11.629243 run create_hlr_db(pid=20353): Launched 09:28:11.750310 bus /gobi_6: Setting Powered False 09:28:12.813468 run create_hlr_db(pid=20353): Terminated: ok {rc=0} 09:28:13.256791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20355): Launched 09:28:13.575055 run osmo-hlr_10.42.42.2(pid=20356): Launched 09:28:13.697558 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:14.250649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20358): Launched 09:28:14.567827 run osmo-stp_10.42.42.5(pid=20359): Launched 09:28:14.688627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:15.238359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20361): Launched 09:28:15.359760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:28:15.628563 run patchelf(pid=20362): Launched 09:28:15.805581 run osmo-stp_10.42.42.5(pid=20359): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20359)] 09:28:15.961933 run osmo-stp_10.42.42.5(pid=20359): stdout: | (launched: 2022-12-09_09:28:14.509445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:16.101886 run osmo-stp_10.42.42.5(pid=20359): stderr: | [0;m[38;5;43m20221209092814697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092814698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092814698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092814698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092814699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092814699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092814699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:16.242911 run osmo-stp_10.42.42.5(pid=20359): stdout: | (launched: 2022-12-09_09:28:14.509445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:16.377195 run osmo-stp_10.42.42.5(pid=20359): stderr: | [0;m[38;5;43m20221209092814697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092814698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092814698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092814698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092814699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092814699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092814699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:16.535895 run patchelf(pid=20362): Terminating (SIGINT) 09:28:16.717754 run patchelf(pid=20362): Terminated: ok {rc=0} 09:28:16.849233 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20359): Process ended prematurely: osmo-stp_10.42.42.5(pid=20359) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20359)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 09:28:16.860003 tst ping.py:22: Test FAILED (6.7 sec) 09:28:16.891711 run osmo-hlr_10.42.42.2(pid=20356): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20356)] 09:28:16.944003 run osmo-hlr_10.42.42.2(pid=20356): stdout: | (launched: 2022-12-09_09:28:13.516541) 09:28:16.998191 run osmo-hlr_10.42.42.2(pid=20356): stderr: | [0;m[1;31m20221209092813712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092813712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092813712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092813712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092813712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092813712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092813725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092813733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092813733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092813733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:17.052621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20355): Terminating (SIGTERM) 09:28:17.096530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20358): Terminating (SIGTERM) 09:28:17.140921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20361): Terminating (SIGTERM) 09:28:17.185205 --- ParallelTerminationStrategy: PID 20355 died... 09:28:17.205263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20355): Terminated: ok {rc=0} 09:28:17.253142 --- ParallelTerminationStrategy: PID 20358 died... 09:28:17.272595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20358): Terminated: ok {rc=0} 09:28:17.320275 --- ParallelTerminationStrategy: PID 20361 died... 09:28:17.340065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20361): Terminated: ok {rc=0} 09:28:17.429597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:28:18.516135 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:18.528395 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:28:18.571477 tst ping_idle_ping.py: using LAC 20516 09:28:18.695900 tst ping_idle_ping.py: using RAC 116 09:28:18.828123 tst ping_idle_ping.py: using CellId 20516 09:28:18.945901 tst ping_idle_ping.py: using BVCI 20517 09:28:19.053922 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:19.065404 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:19.076565 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:19.088554 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:19.100279 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:19.112011 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:19.123951 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:28:19.135590 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:28:19.255216 tst ping_idle_ping.py:24: start network... 09:28:19.469434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:19.970520 run create_hlr_db(pid=20363): Launched 09:28:20.093328 bus /gobi_6: Setting Powered False 09:28:21.157529 run create_hlr_db(pid=20363): Terminated: ok {rc=0} 09:28:21.585045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20365): Launched 09:28:21.885354 run osmo-hlr_10.42.42.2(pid=20366): Launched 09:28:21.999368 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:22.524317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20368): Launched 09:28:22.821734 run osmo-stp_10.42.42.5(pid=20369): Launched 09:28:22.934365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:23.445175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20371): Launched 09:28:23.558711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:28:23.809712 run patchelf(pid=20372): Launched 09:28:23.974586 run osmo-stp_10.42.42.5(pid=20369): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20369)] 09:28:24.100098 run osmo-stp_10.42.42.5(pid=20369): stdout: | (launched: 2022-12-09_09:28:22.766748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:24.227580 run osmo-stp_10.42.42.5(pid=20369): stderr: | [0;m[38;5;43m20221209092822935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092822935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092822935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092822936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092822936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092822936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092822936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:24.354815 run osmo-stp_10.42.42.5(pid=20369): stdout: | (launched: 2022-12-09_09:28:22.766748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:24.476884 run osmo-stp_10.42.42.5(pid=20369): stderr: | [0;m[38;5;43m20221209092822935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092822935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092822935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092822936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092822936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092822936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092822936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:24.621397 run patchelf(pid=20372): Terminating (SIGINT) 09:28:24.787575 run patchelf(pid=20372): Terminated: ok {rc=0} 09:28:24.907466 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20369): Process ended prematurely: osmo-stp_10.42.42.5(pid=20369) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20369)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:28:24.916192 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:28:24.942652 run osmo-hlr_10.42.42.2(pid=20366): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20366)] 09:28:24.989421 run osmo-hlr_10.42.42.2(pid=20366): stdout: | (launched: 2022-12-09_09:28:21.830201) 09:28:25.038041 run osmo-hlr_10.42.42.2(pid=20366): stderr: | [0;m[1;31m20221209092822001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092822001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092822001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092822001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092822001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092822002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092822014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092822025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092822025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092822025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:25.087192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20365): Terminating (SIGTERM) 09:28:25.126599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20368): Terminating (SIGTERM) 09:28:25.165984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20371): Terminating (SIGTERM) 09:28:25.205500 --- ParallelTerminationStrategy: PID 20365 died... 09:28:25.224251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20365): Terminated: ok {rc=0} 09:28:25.267708 --- ParallelTerminationStrategy: PID 20368 died... 09:28:25.286316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20368): Terminated: ok {rc=0} 09:28:25.329588 --- ParallelTerminationStrategy: PID 20371 died... 09:28:25.347896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20371): Terminated: ok {rc=0} 09:28:25.429842 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:28:26.736437 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:28:26.745951 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:28:26.772364 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:28:26.813726 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:28:26.906689 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:28:26.931044 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:28:26.970199 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:28:27.565990 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:28:27.620639 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:27.632435 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:28:27.700628 tst cs_paging_gprs_active.py: using LAC 20517 09:28:27.826943 tst cs_paging_gprs_active.py: using RAC 117 09:28:27.951854 tst cs_paging_gprs_active.py: using CellId 20517 09:28:28.076556 tst cs_paging_gprs_active.py: using BVCI 20518 09:28:28.196065 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.207672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.219224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.230931 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.242612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.254747 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.266740 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.278518 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:28.290459 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:28:28.408040 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:28:28.523094 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:28:28.725907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:29.029725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20377): Launched 09:28:29.292664 run iperf3-srv_10.42.42.10(pid=20378): Launched 09:28:29.405574 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:28:29.607346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:29.911311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20380): Launched 09:28:30.173049 run iperf3-srv_10.42.42.10(pid=20381): Launched 09:28:30.286080 tst cs_paging_gprs_active.py:38: start network... 09:28:30.487511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:30.965387 run create_hlr_db(pid=20382): Launched 09:28:31.110761 bus /gobi_6: Setting Powered False 09:28:32.173738 run create_hlr_db(pid=20382): Terminated: ok {rc=0} 09:28:32.628317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20384): Launched 09:28:32.952258 run osmo-hlr_10.42.42.2(pid=20385): Launched 09:28:33.076303 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:33.632877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20387): Launched 09:28:33.956253 run osmo-stp_10.42.42.5(pid=20388): Launched 09:28:34.079176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:34.638472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20390): Launched 09:28:34.761651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:28:35.035270 run patchelf(pid=20391): Launched 09:28:35.215432 run osmo-stp_10.42.42.5(pid=20388): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20388)] 09:28:35.352440 run osmo-stp_10.42.42.5(pid=20388): stdout: | (launched: 2022-12-09_09:28:33.897441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:35.490853 run osmo-stp_10.42.42.5(pid=20388): stderr: | [0;m[38;5;43m20221209092834086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092834086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092834086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092834087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092834087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092834087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092834087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:35.629758 run osmo-stp_10.42.42.5(pid=20388): stdout: | (launched: 2022-12-09_09:28:33.897441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:35.762536 run osmo-stp_10.42.42.5(pid=20388): stderr: | [0;m[38;5;43m20221209092834086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092834086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092834086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092834087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092834087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092834087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092834087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:35.922081 run patchelf(pid=20391): Terminating (SIGINT) 09:28:36.103305 run patchelf(pid=20391): Terminated: ok {rc=0} 09:28:36.234575 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20388): Process ended prematurely: osmo-stp_10.42.42.5(pid=20388) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20388)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:28:36.244731 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:28:36.274028 run osmo-hlr_10.42.42.2(pid=20385): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20385)] 09:28:36.324054 run osmo-hlr_10.42.42.2(pid=20385): stdout: | (launched: 2022-12-09_09:28:32.893492) 09:28:36.375870 run osmo-hlr_10.42.42.2(pid=20385): stderr: | [0;m[1;31m20221209092833089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092833089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092833089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092833089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092833089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092833089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092833102 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092833113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092833113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092833113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:36.428248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20377): Terminating (SIGTERM) 09:28:36.470737 run iperf3-srv_10.42.42.10(pid=20378): Terminating (SIGTERM) 09:28:36.512602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20380): Terminating (SIGTERM) 09:28:36.554523 run iperf3-srv_10.42.42.10(pid=20381): Terminating (SIGTERM) 09:28:36.596415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20384): Terminating (SIGTERM) 09:28:36.638679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20387): Terminating (SIGTERM) 09:28:36.680599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20390): Terminating (SIGTERM) 09:28:36.722836 --- ParallelTerminationStrategy: PID 20377 died... 09:28:36.742996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20377): Terminated: ok {rc=0} 09:28:36.789487 --- ParallelTerminationStrategy: PID 20378 died... 09:28:36.808713 run iperf3-srv_10.42.42.10(pid=20378): Terminated {rc=256} 09:28:36.854863 --- ParallelTerminationStrategy: PID 20380 died... 09:28:36.874311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20380): Terminated: ok {rc=0} 09:28:36.920802 --- ParallelTerminationStrategy: PID 20381 died... 09:28:36.940509 run iperf3-srv_10.42.42.10(pid=20381): Terminated {rc=256} 09:28:36.986693 --- ParallelTerminationStrategy: PID 20384 died... 09:28:37.006480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20384): Terminated: ok {rc=0} 09:28:37.052881 --- ParallelTerminationStrategy: PID 20387 died... 09:28:37.072803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20387): Terminated: ok {rc=0} 09:28:37.119016 --- ParallelTerminationStrategy: PID 20390 died... 09:28:37.138505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20390): Terminated: ok {rc=0} 09:28:37.225649 bus /gobi_0: Setting Powered False 09:28:38.324055 bus /gobi_0: Setting Powered False 09:28:39.439292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:28:40.587849 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:40.600420 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:28:40.665835 tst iperf3.py: using LAC 20518 09:28:40.792720 tst iperf3.py: using RAC 118 09:28:40.918701 tst iperf3.py: using CellId 20518 09:28:41.046329 tst iperf3.py: using BVCI 20519 09:28:41.163659 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.175363 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.186777 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.198699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.210337 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.222109 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.233955 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.245933 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:41.257821 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:28:41.376793 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:28:41.581493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:41.889698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20392): Launched 09:28:42.173572 run iperf3-srv_10.42.42.10(pid=20393): Launched 09:28:42.294802 tst iperf3.py:8: start network... 09:28:42.513169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:42.988073 run create_hlr_db(pid=20394): Launched 09:28:43.111263 bus /gobi_6: Setting Powered False 09:28:44.171951 run create_hlr_db(pid=20394): Terminated: ok {rc=0} 09:28:44.593130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Launched 09:28:44.894654 run osmo-hlr_10.42.42.2(pid=20397): Launched 09:28:45.008533 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:45.542445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Launched 09:28:45.859037 run osmo-stp_10.42.42.5(pid=20401): Launched 09:28:46.076831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:46.726717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20403): Launched 09:28:46.863728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:28:47.147554 run patchelf(pid=20404): Launched 09:28:47.341195 run osmo-stp_10.42.42.5(pid=20401): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] 09:28:47.479095 run osmo-stp_10.42.42.5(pid=20401): stdout: | (launched: 2022-12-09_09:28:45.788611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:47.619124 run osmo-stp_10.42.42.5(pid=20401): stderr: | [0;m[38;5;43m20221209092846144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092846144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092846158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092846158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092846159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092846159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092846159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:47.758917 run osmo-stp_10.42.42.5(pid=20401): stdout: | (launched: 2022-12-09_09:28:45.788611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:47.892483 run osmo-stp_10.42.42.5(pid=20401): stderr: | [0;m[38;5;43m20221209092846144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092846144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092846158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092846158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092846159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092846159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092846159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:48.051230 run patchelf(pid=20404): Terminating (SIGINT) 09:28:48.234545 run patchelf(pid=20404): Terminated: ok {rc=0} 09:28:48.365975 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20401): Process ended prematurely: osmo-stp_10.42.42.5(pid=20401) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:28:48.376276 tst iperf3.py:8: Test FAILED (7.8 sec) 09:28:48.406490 run osmo-hlr_10.42.42.2(pid=20397): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20397)] 09:28:48.457469 run osmo-hlr_10.42.42.2(pid=20397): stdout: | (launched: 2022-12-09_09:28:44.838973) 09:28:48.510207 run osmo-hlr_10.42.42.2(pid=20397): stderr: | [0;m[1;31m20221209092845014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092845014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092845014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092845014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092845014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092845014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092845027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092845037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092845037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092845037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:48.562926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20392): Terminating (SIGTERM) 09:28:48.605628 run iperf3-srv_10.42.42.10(pid=20393): Terminating (SIGTERM) 09:28:48.648331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Terminating (SIGTERM) 09:28:48.691100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Terminating (SIGTERM) 09:28:48.733811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20403): Terminating (SIGTERM) 09:28:48.776667 --- ParallelTerminationStrategy: PID 20392 died... 09:28:48.796617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20392): Terminated: ok {rc=0} 09:28:48.844428 --- ParallelTerminationStrategy: PID 20393 died... 09:28:48.863914 run iperf3-srv_10.42.42.10(pid=20393): Terminated {rc=256} 09:28:48.911569 --- ParallelTerminationStrategy: PID 20396 died... 09:28:48.931111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Terminated: ok {rc=0} 09:28:48.978621 --- ParallelTerminationStrategy: PID 20400 died... 09:28:48.998304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Terminated: ok {rc=0} 09:28:49.045877 --- ParallelTerminationStrategy: PID 20403 died... 09:28:49.065419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20403): Terminated: ok {rc=0} 09:28:49.154461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:28:50.304452 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.316750 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:28:50.379312 tst iperf3m4.py: using LAC 20519 09:28:50.505952 tst iperf3m4.py: using RAC 119 09:28:50.637548 tst iperf3m4.py: using CellId 20519 09:28:50.766825 tst iperf3m4.py: using BVCI 20520 09:28:50.885278 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.897038 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.908447 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.920216 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.931782 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.943505 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.955255 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.966908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:28:50.978783 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:28:51.098710 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:28:51.222979 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:28:51.342184 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:28:51.464115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:28:51.683275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:52.008840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20405): Launched 09:28:52.291637 run iperf3-srv_10.42.42.10(pid=20406): Launched 09:28:52.412821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:28:52.631508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:52.957609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20407): Launched 09:28:53.239820 run iperf3-srv_10.42.42.10(pid=20408): Launched 09:28:53.360834 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:28:53.579340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:53.904756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20409): Launched 09:28:54.186768 run iperf3-srv_10.42.42.10(pid=20410): Launched 09:28:54.308253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:28:54.526049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:28:54.851426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20411): Launched 09:28:55.133747 run iperf3-srv_10.42.42.10(pid=20412): Launched 09:28:55.254689 tst iperf3m4.py:8: start network... 09:28:55.472139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:55.974538 run create_hlr_db(pid=20413): Launched 09:28:56.097782 bus /gobi_6: Setting Powered False 09:28:57.162294 run create_hlr_db(pid=20413): Terminated: ok {rc=0} 09:28:57.611704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20415): Launched 09:28:57.934841 run osmo-hlr_10.42.42.2(pid=20416): Launched 09:28:58.059657 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:58.621201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20418): Launched 09:28:58.944753 run osmo-stp_10.42.42.5(pid=20419): Launched 09:28:59.069090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:28:59.629969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20421): Launched 09:28:59.753716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:00.028636 run patchelf(pid=20422): Launched 09:29:00.210216 run osmo-stp_10.42.42.5(pid=20419): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20419)] 09:29:00.347499 run osmo-stp_10.42.42.5(pid=20419): stdout: | (launched: 2022-12-09_09:28:58.885340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:00.486747 run osmo-stp_10.42.42.5(pid=20419): stderr: | [0;m[38;5;43m20221209092859075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092859075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092859076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092859076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092859077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092859077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092859077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:00.625711 run osmo-stp_10.42.42.5(pid=20419): stdout: | (launched: 2022-12-09_09:28:58.885340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:00.759034 run osmo-stp_10.42.42.5(pid=20419): stderr: | [0;m[38;5;43m20221209092859075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092859075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092859076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092859076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092859077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092859077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092859077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:00.918976 run patchelf(pid=20422): Terminating (SIGINT) 09:29:01.104259 run patchelf(pid=20422): Terminated: ok {rc=0} 09:29:01.239203 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20419): Process ended prematurely: osmo-stp_10.42.42.5(pid=20419) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20419)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:29:01.250571 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:29:01.283156 run osmo-hlr_10.42.42.2(pid=20416): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20416)] 09:29:01.335915 run osmo-hlr_10.42.42.2(pid=20416): stdout: | (launched: 2022-12-09_09:28:57.875530) 09:29:01.390524 run osmo-hlr_10.42.42.2(pid=20416): stderr: | [0;m[1;31m20221209092858072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092858072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092858072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092858072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092858072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092858072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092858084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092858092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092858093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092858093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:01.445568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20405): Terminating (SIGTERM) 09:29:01.490071 run iperf3-srv_10.42.42.10(pid=20406): Terminating (SIGTERM) 09:29:01.535763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20407): Terminating (SIGTERM) 09:29:01.580423 run iperf3-srv_10.42.42.10(pid=20408): Terminating (SIGTERM) 09:29:01.624635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20409): Terminating (SIGTERM) 09:29:01.669585 run iperf3-srv_10.42.42.10(pid=20410): Terminating (SIGTERM) 09:29:01.716549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20411): Terminating (SIGTERM) 09:29:01.761060 run iperf3-srv_10.42.42.10(pid=20412): Terminating (SIGTERM) 09:29:01.805086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20415): Terminating (SIGTERM) 09:29:01.849418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20418): Terminating (SIGTERM) 09:29:01.893744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20421): Terminating (SIGTERM) 09:29:01.938705 --- ParallelTerminationStrategy: PID 20405 died... 09:29:01.959383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20405): Terminated: ok {rc=0} 09:29:02.009570 --- ParallelTerminationStrategy: PID 20406 died... 09:29:02.030511 run iperf3-srv_10.42.42.10(pid=20406): Terminated {rc=256} 09:29:02.080413 --- ParallelTerminationStrategy: PID 20407 died... 09:29:02.101182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20407): Terminated: ok {rc=0} 09:29:02.151013 --- ParallelTerminationStrategy: PID 20408 died... 09:29:02.171608 run iperf3-srv_10.42.42.10(pid=20408): Terminated {rc=256} 09:29:02.220296 --- ParallelTerminationStrategy: PID 20409 died... 09:29:02.240068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20409): Terminated: ok {rc=0} 09:29:02.286934 --- ParallelTerminationStrategy: PID 20410 died... 09:29:02.306472 run iperf3-srv_10.42.42.10(pid=20410): Terminated {rc=256} 09:29:02.352885 --- ParallelTerminationStrategy: PID 20411 died... 09:29:02.373035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20411): Terminated: ok {rc=0} 09:29:02.419640 --- ParallelTerminationStrategy: PID 20412 died... 09:29:02.439215 run iperf3-srv_10.42.42.10(pid=20412): Terminated {rc=256} 09:29:02.485597 --- ParallelTerminationStrategy: PID 20415 died... 09:29:02.505162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20415): Terminated: ok {rc=0} 09:29:02.551451 --- ParallelTerminationStrategy: PID 20418 died... 09:29:02.571149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20418): Terminated: ok {rc=0} 09:29:02.617428 --- ParallelTerminationStrategy: PID 20421 died... 09:29:02.637497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20421): Terminated: ok {rc=0} 09:29:02.724929 bus /gobi_4: Setting Powered False 09:29:03.823013 bus /gobi_4: Setting Powered False 09:29:04.936313 bus /gobi_1: Setting Powered False 09:29:06.031082 bus /gobi_1: Setting Powered False 09:29:07.144182 bus /gobi_0: Setting Powered False 09:29:08.241490 bus /gobi_0: Setting Powered False 09:29:09.357084 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:29:10.460248 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:10.472794 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:29:10.536630 tst ping.py: using LAC 20520 09:29:10.660504 tst ping.py: using RAC 120 09:29:10.785273 tst ping.py: using CellId 20520 09:29:10.908904 tst ping.py: using BVCI 20521 09:29:11.024719 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:11.036425 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:11.048415 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:11.060163 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:11.071827 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:11.083554 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:11.095265 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:11.106881 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:29:11.230009 tst ping.py:19: start network... 09:29:11.444085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:11.938459 run create_hlr_db(pid=20423): Launched 09:29:12.059500 bus /gobi_6: Setting Powered False 09:29:13.122388 run create_hlr_db(pid=20423): Terminated: ok {rc=0} 09:29:13.549142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20425): Launched 09:29:13.848043 run osmo-hlr_10.42.42.2(pid=20426): Launched 09:29:13.961691 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:14.483417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20428): Launched 09:29:14.782992 run osmo-stp_10.42.42.5(pid=20429): Launched 09:29:14.896071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:15.452103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20431): Launched 09:29:15.573670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:15.846035 run patchelf(pid=20432): Launched 09:29:16.042894 run osmo-stp_10.42.42.5(pid=20429): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20429)] 09:29:16.182581 run osmo-stp_10.42.42.5(pid=20429): stdout: | (launched: 2022-12-09_09:29:14.727190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:16.323198 run osmo-stp_10.42.42.5(pid=20429): stderr: | [0;m[38;5;43m20221209092914895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092914895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092914895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092914896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092914896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092914896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092914896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:16.463341 run osmo-stp_10.42.42.5(pid=20429): stdout: | (launched: 2022-12-09_09:29:14.727190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:16.597841 run osmo-stp_10.42.42.5(pid=20429): stderr: | [0;m[38;5;43m20221209092914895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092914895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092914895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092914896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092914896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092914896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092914896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:16.756755 run patchelf(pid=20432): Terminating (SIGINT) 09:29:16.939544 run patchelf(pid=20432): Terminated: ok {rc=0} 09:29:17.071716 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20429): Process ended prematurely: osmo-stp_10.42.42.5(pid=20429) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20429)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 09:29:17.082500 tst ping.py:22: Test FAILED (6.6 sec) 09:29:17.113976 run osmo-hlr_10.42.42.2(pid=20426): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20426)] 09:29:17.165937 run osmo-hlr_10.42.42.2(pid=20426): stdout: | (launched: 2022-12-09_09:29:13.792496) 09:29:17.218191 run osmo-hlr_10.42.42.2(pid=20426): stderr: | [0;m[1;31m20221209092913965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092913965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092913965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092913965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092913965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092913965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092913977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092913986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092913986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092913986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:17.270530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20425): Terminating (SIGTERM) 09:29:17.312552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20428): Terminating (SIGTERM) 09:29:17.354690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20431): Terminating (SIGTERM) 09:29:17.397296 --- ParallelTerminationStrategy: PID 20425 died... 09:29:17.417392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20425): Terminated: ok {rc=0} 09:29:17.464351 --- ParallelTerminationStrategy: PID 20428 died... 09:29:17.484078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20428): Terminated: ok {rc=0} 09:29:17.531255 --- ParallelTerminationStrategy: PID 20431 died... 09:29:17.550916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20431): Terminated: ok {rc=0} 09:29:17.638946 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:29:18.725047 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:18.737585 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:29:18.800372 tst ping_idle_ping.py: using LAC 20521 09:29:18.927222 tst ping_idle_ping.py: using RAC 121 09:29:19.044412 tst ping_idle_ping.py: using CellId 20521 09:29:19.161060 tst ping_idle_ping.py: using BVCI 20522 09:29:19.269672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:19.280734 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:19.291766 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:19.302825 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:19.313664 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:19.324449 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:19.335773 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:29:19.346714 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:29:19.463111 tst ping_idle_ping.py:24: start network... 09:29:19.662153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:20.127616 run create_hlr_db(pid=20433): Launched 09:29:20.251662 bus /gobi_6: Setting Powered False 09:29:21.312337 run create_hlr_db(pid=20433): Terminated: ok {rc=0} 09:29:21.728302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20435): Launched 09:29:22.027498 run osmo-hlr_10.42.42.2(pid=20436): Launched 09:29:22.141301 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:22.665118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20438): Launched 09:29:22.962334 run osmo-stp_10.42.42.5(pid=20439): Launched 09:29:23.076635 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:23.590150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20441): Launched 09:29:23.703243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:23.954303 run patchelf(pid=20442): Launched 09:29:24.118786 run osmo-stp_10.42.42.5(pid=20439): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20439)] 09:29:24.245389 run osmo-stp_10.42.42.5(pid=20439): stdout: | (launched: 2022-12-09_09:29:22.906827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:24.372411 run osmo-stp_10.42.42.5(pid=20439): stderr: | [0;m[38;5;43m20221209092923075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092923075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092923075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092923076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092923076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092923076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092923076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:24.499562 run osmo-stp_10.42.42.5(pid=20439): stdout: | (launched: 2022-12-09_09:29:22.906827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:24.621078 run osmo-stp_10.42.42.5(pid=20439): stderr: | [0;m[38;5;43m20221209092923075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092923075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092923075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092923076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092923076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092923076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092923076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:24.765368 run patchelf(pid=20442): Terminating (SIGINT) 09:29:24.931541 run patchelf(pid=20442): Terminated: ok {rc=0} 09:29:25.051898 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20439): Process ended prematurely: osmo-stp_10.42.42.5(pid=20439) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20439)] [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:29:25.060776 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:29:25.087343 run osmo-hlr_10.42.42.2(pid=20436): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20436)] 09:29:25.134329 run osmo-hlr_10.42.42.2(pid=20436): stdout: | (launched: 2022-12-09_09:29:21.971784) 09:29:25.183068 run osmo-hlr_10.42.42.2(pid=20436): stderr: | [0;m[1;31m20221209092922147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092922147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092922147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092922147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092922147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092922147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092922159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092922168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092922168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092922168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:25.232250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20435): Terminating (SIGTERM) 09:29:25.271710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20438): Terminating (SIGTERM) 09:29:25.312588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20441): Terminating (SIGTERM) 09:29:25.352243 --- ParallelTerminationStrategy: PID 20435 died... 09:29:25.371386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20435): Terminated: ok {rc=0} 09:29:25.415055 --- ParallelTerminationStrategy: PID 20438 died... 09:29:25.433539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20438): Terminated: ok {rc=0} 09:29:25.477263 --- ParallelTerminationStrategy: PID 20441 died... 09:29:25.495610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20441): Terminated: ok {rc=0} 09:29:25.579159 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:29:26.871348 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:26.878722 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:29:26.902649 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:29:26.937439 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:29:26.991263 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:29:27.015464 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:29:27.050209 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:29:27.616869 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:29:27.623228 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:27.635860 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:29:27.701100 tst switch_tch_pdch.py: using LAC 20522 09:29:27.826936 tst switch_tch_pdch.py: using RAC 122 09:29:27.953137 tst switch_tch_pdch.py: using CellId 20522 09:29:28.077446 tst switch_tch_pdch.py: using BVCI 20523 09:29:28.187008 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:28.199167 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:28.210749 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:28.222840 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:28.235852 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:28.250626 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:28.263419 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:29:28.276152 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:29:28.395796 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:29:28.513532 tst switch_tch_pdch.py:51: start network... 09:29:28.712421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:29.176062 run create_hlr_db(pid=20448): Launched 09:29:29.299668 bus /gobi_6: Setting Powered False 09:29:30.362636 run create_hlr_db(pid=20448): Terminated: ok {rc=0} 09:29:30.789473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20450): Launched 09:29:31.121720 run osmo-hlr_10.42.42.2(pid=20451): Launched 09:29:31.332362 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:31.954820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20453): Launched 09:29:32.273667 run osmo-stp_10.42.42.5(pid=20454): Launched 09:29:32.422097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:29:32.946405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20456): Launched 09:29:33.059636 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:29:33.311400 run patchelf(pid=20457): Launched 09:29:33.476185 run osmo-stp_10.42.42.5(pid=20454): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20454)] 09:29:33.601806 run osmo-stp_10.42.42.5(pid=20454): stdout: | (launched: 2022-12-09_09:29:32.209636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:33.728912 run osmo-stp_10.42.42.5(pid=20454): stderr: | [0;m[38;5;43m20221209092932425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092932426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092932426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092932426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092932427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092932427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092932427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:33.856166 run osmo-stp_10.42.42.5(pid=20454): stdout: | (launched: 2022-12-09_09:29:32.209636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:33.977519 run osmo-stp_10.42.42.5(pid=20454): stderr: | [0;m[38;5;43m20221209092932425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092932426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092932426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092932426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092932427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092932427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092932427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:34.121815 run patchelf(pid=20457): Terminating (SIGINT) 09:29:34.288710 run patchelf(pid=20457): Terminated: ok {rc=0} 09:29:34.408474 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20454): Process ended prematurely: osmo-stp_10.42.42.5(pid=20454) [trial-2357↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20454)] [trial-2357↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:29:34.417553 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 09:29:34.444196 run osmo-hlr_10.42.42.2(pid=20451): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20451)] 09:29:34.491579 run osmo-hlr_10.42.42.2(pid=20451): stdout: | (launched: 2022-12-09_09:29:31.059777) 09:29:34.540670 run osmo-hlr_10.42.42.2(pid=20451): stderr: | [0;m[1;31m20221209092931428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092931429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092931429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092931429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092931429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092931429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092931452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092931478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092931479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092931479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:34.590299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20450): Terminating (SIGTERM) 09:29:34.630195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20453): Terminating (SIGTERM) 09:29:34.669873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20456): Terminating (SIGTERM) 09:29:34.709788 --- ParallelTerminationStrategy: PID 20450 died... 09:29:34.728837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20450): Terminated: ok {rc=0} 09:29:34.773140 --- ParallelTerminationStrategy: PID 20453 died... 09:29:34.791716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20453): Terminated: ok {rc=0} 09:29:34.835087 --- ParallelTerminationStrategy: PID 20456 died... 09:29:34.853617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20456): Terminated: ok {rc=0} 09:29:34.938924 bus /gobi_0: Setting Powered False 09:29:36.040687 bus /gobi_0: Setting Powered False 09:29:37.157850 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 sms:nanobts+band-900 --------------------------------------------------------------------- 09:29:38.410012 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:38.415238 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:29:38.447733 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:29:38.474620 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 09:29:38.527191 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:29:38.559741 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:29:38.586655 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 09:29:39.138921 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 09:29:39.144466 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:39.155892 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 09:29:39.205067 tst mo_mt_sms.py: using LAC 20523 09:29:39.329040 tst mo_mt_sms.py: using RAC 123 09:29:39.455126 tst mo_mt_sms.py: using CellId 20523 09:29:39.583927 tst mo_mt_sms.py: using BVCI 20524 09:29:39.699283 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:39.710621 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:39.721840 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:39.733297 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:39.744606 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:39.755982 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:29:39.877287 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:29:39.993576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:40.456353 run create_hlr_db(pid=20461): Launched 09:29:40.577689 bus /gobi_6: Setting Powered False 09:29:41.637276 run create_hlr_db(pid=20461): Terminated: ok {rc=0} 09:29:42.072211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20463): Launched 09:29:42.391462 run osmo-hlr_10.42.42.2(pid=20464): Launched 09:29:42.513311 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:43.065206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20466): Launched 09:29:43.384205 run osmo-stp_10.42.42.5(pid=20467): Launched 09:29:43.505539 run osmo-msc_10.42.42.6: Starting osmo-msc 09:29:44.082056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20469): Launched 09:29:44.402123 run osmo-msc_10.42.42.6(pid=20470): Launched 09:29:44.581191 run osmo-stp_10.42.42.5(pid=20467): ERR: Terminated: ERROR {rc=1} [trial-2357↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20467)] 09:29:44.715846 run osmo-stp_10.42.42.5(pid=20467): stdout: | (launched: 2022-12-09_09:29:43.325463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:44.851785 run osmo-stp_10.42.42.5(pid=20467): stderr: | [0;m[38;5;43m20221209092943515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092943515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092943515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092943516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092943516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092943516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092943516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:44.985497 run osmo-stp_10.42.42.5(pid=20467): stdout: | (launched: 2022-12-09_09:29:43.325463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:45.112480 run osmo-stp_10.42.42.5(pid=20467): stderr: | [0;m[38;5;43m20221209092943515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092943515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092943515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092943516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092943516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092943516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092943516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:45.264853 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20467): Process ended prematurely: osmo-stp_10.42.42.5(pid=20467) [trial-2357↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20467)] [trial-2357↪sms:nanobts+band-900↪mo_mt_sms.py:16] 09:29:45.273841 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 09:29:45.301536 run osmo-hlr_10.42.42.2(pid=20464): ERR: Terminated: ERROR {rc=237} [trial-2357↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20464)] 09:29:45.351653 run osmo-hlr_10.42.42.2(pid=20464): stdout: | (launched: 2022-12-09_09:29:42.332459) 09:29:45.403192 run osmo-hlr_10.42.42.2(pid=20464): stderr: | [0;m[1;31m20221209092942529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092942529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092942529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092942529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092942529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092942529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092942541 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092942549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092942549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092942549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:45.475076 run osmo-msc_10.42.42.6(pid=20470): ERR: Terminated: ERROR {rc=2} [trial-2357↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20470)] 09:29:45.524918 run osmo-msc_10.42.42.6(pid=20470): stdout: | (launched: 2022-12-09_09:29:44.342879) 09:29:45.576282 run osmo-msc_10.42.42.6(pid=20470): stderr: | [0;m[38;5;43m20221209092944664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209092944664 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff135bc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209092944664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209092944664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209092944664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209092944664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209092944666 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209092944667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209092944667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209092944667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:29:45.628206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20463): Terminating (SIGTERM) 09:29:45.670175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20466): Terminating (SIGTERM) 09:29:45.712004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20469): Terminating (SIGTERM) 09:29:45.754187 --- ParallelTerminationStrategy: PID 20463 died... 09:29:45.774199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20463): Terminated: ok {rc=0} 09:29:45.820393 --- ParallelTerminationStrategy: PID 20466 died... 09:29:45.840186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20466): Terminated: ok {rc=0} 09:29:45.889440 --- ParallelTerminationStrategy: PID 20469 died... 09:29:45.923854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20469): Terminated: ok {rc=0} 09:29:46.014285 bus /sierra_3: Setting Powered False 09:29:47.128438 bus /sierra_3: Setting Powered False 09:29:48.260625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 09:29:49.495344 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:49.499997 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:29:49.532934 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 09:29:49.540444 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:29:49.577336 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:29:49.609972 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 09:29:49.616815 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:29:50.135824 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:29:50.141144 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 09:29:50.152092 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:29:50.199536 tst assert_extension.py: using LAC 20524 09:29:50.317634 tst assert_extension.py: using RAC 124 09:29:50.434701 tst assert_extension.py: using CellId 20524 09:29:50.553381 tst assert_extension.py: using BVCI 20525 09:29:50.660347 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:29:50.777781 tst assert_extension.py:10: start nitb and bts... 09:29:50.992686 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:29:51.645131 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20475): Launched 09:29:51.964225 run osmo-nitb_10.42.42.2(pid=20476): Launched 09:29:52.140591 run osmo-nitb_10.42.42.2(pid=20476): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20476)] 09:29:52.283890 run osmo-nitb_10.42.42.2(pid=20476): stdout: | (launched: 2022-12-09_09:29:51.905541) 09:29:52.428458 run osmo-nitb_10.42.42.2(pid=20476): stderr: | (launched: 2022-12-09_09:29:51.953124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:29:52.573265 run osmo-nitb_10.42.42.2(pid=20476): stdout: | (launched: 2022-12-09_09:29:51.905541) 09:29:52.712266 run osmo-nitb_10.42.42.2(pid=20476): stderr: | (launched: 2022-12-09_09:29:51.953124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20476): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20476) [trial-2357↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20476)] 09:29:53.084611 tst osmo-nitb_10.42.42.2(pid=20476): stdout: | (launched: 2022-12-09_09:29:51.905541) 09:29:53.214142 tst osmo-nitb_10.42.42.2(pid=20476): stderr: | (launched: 2022-12-09_09:29:51.953124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:29:53.366025 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20476): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20476) [trial-2357↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20476)] [trial-2357↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 09:29:53.375061 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:29:53.382048 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20475): Terminating (SIGTERM) 09:29:53.593245 --- ParallelTerminationStrategy: PID 20475 died... 09:29:53.614318 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20475): Terminated: ok {rc=0} 09:29:53.701447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 ussd:nanobts+band-900 --------------------------------------------------------------------- 09:29:54.889306 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:54.893930 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:29:54.926163 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:29:54.952898 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:29:54.987876 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:29:55.020413 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:29:55.047437 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:29:55.577822 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:29:55.583117 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:55.594159 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:29:55.643861 tst assert_extension.py: using LAC 20525 09:29:55.758974 tst assert_extension.py: using RAC 125 09:29:55.874288 tst assert_extension.py: using CellId 20525 09:29:55.990481 tst assert_extension.py: using BVCI 20526 09:29:56.098259 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:56.109142 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:56.119806 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:56.130406 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:56.141071 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:56.151593 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:29:56.267982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:56.764435 run create_hlr_db(pid=20480): Launched 09:29:56.887128 bus /sierra_2: Setting Powered False 09:29:57.950236 run create_hlr_db(pid=20480): Terminated: ok {rc=0} 09:29:58.377947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20482): Launched 09:29:58.677637 run osmo-hlr_10.42.42.2(pid=20483): Launched 09:29:58.792059 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:59.306196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20485): Launched 09:29:59.603723 run osmo-stp_10.42.42.5(pid=20486): Launched 09:29:59.716761 run osmo-msc_10.42.42.6: Starting osmo-msc 09:30:00.253919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20488): Launched 09:30:00.552289 run osmo-msc_10.42.42.6(pid=20489): Launched 09:30:00.718336 run osmo-stp_10.42.42.5(pid=20486): ERR: Terminated: ERROR {rc=1} [trial-2357↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20486)] 09:30:00.898563 run osmo-stp_10.42.42.5(pid=20486): stdout: | (launched: 2022-12-09_09:29:59.548456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:01.032118 run osmo-stp_10.42.42.5(pid=20486): stderr: | [0;m[38;5;43m20221209092959718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092959718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092959718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092959718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092959719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092959719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092959719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:01.159896 run osmo-stp_10.42.42.5(pid=20486): stdout: | (launched: 2022-12-09_09:29:59.548456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:01.280665 run osmo-stp_10.42.42.5(pid=20486): stderr: | [0;m[38;5;43m20221209092959718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209092959718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209092959718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209092959718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209092959719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209092959719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209092959719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:01.424939 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20486): Process ended prematurely: osmo-stp_10.42.42.5(pid=20486) [trial-2357↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20486)] [trial-2357↪ussd:nanobts+band-900↪assert_extension.py:17] 09:30:01.434442 tst assert_extension.py:17: Test FAILED (5.8 sec) 09:30:01.471188 run osmo-hlr_10.42.42.2(pid=20483): ERR: Terminated: ERROR {rc=237} [trial-2357↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20483)] 09:30:01.521976 run osmo-hlr_10.42.42.2(pid=20483): stdout: | (launched: 2022-12-09_09:29:58.622256) 09:30:01.575279 run osmo-hlr_10.42.42.2(pid=20483): stderr: | [0;m[1;31m20221209092958796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209092958796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209092958796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209092958796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209092958797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209092958797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209092958809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209092958818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209092958818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209092958818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:01.645617 run osmo-msc_10.42.42.6(pid=20489): ERR: Terminated: ERROR {rc=2} [trial-2357↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20489)] 09:30:01.694793 run osmo-msc_10.42.42.6(pid=20489): stdout: | (launched: 2022-12-09_09:30:00.496266) 09:30:01.745356 run osmo-msc_10.42.42.6(pid=20489): stderr: | [0;m[38;5;43m20221209093000767 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093000769 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe7dc750c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093000769 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093000769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093000769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093000769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093000771 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093000771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093000772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093000772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:30:01.796701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20482): Terminating (SIGTERM) 09:30:01.838270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20485): Terminating (SIGTERM) 09:30:01.902107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20488): Terminating (SIGTERM) 09:30:01.958316 --- ParallelTerminationStrategy: PID 20482 died... 09:30:01.982095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20482): Terminated: ok {rc=0} 09:30:02.031652 --- ParallelTerminationStrategy: PID 20485 died... 09:30:02.051184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20485): Terminated: ok {rc=0} 09:30:02.096504 --- ParallelTerminationStrategy: PID 20488 died... 09:30:02.115709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20488): Terminated: ok {rc=0} 09:30:02.204866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:30:03.414335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:30:03.421859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:30:03.454596 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:30:03.481540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:30:03.534680 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:30:03.568763 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:30:03.597253 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:30:04.150572 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:30:04.204817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:04.216847 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:30:04.286195 tst mo_mt_call.py: using LAC 20526 09:30:04.413563 tst mo_mt_call.py: using RAC 126 09:30:04.537812 tst mo_mt_call.py: using CellId 20526 09:30:04.656735 tst mo_mt_call.py: using BVCI 20527 09:30:04.766321 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:04.777681 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:04.788746 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:04.799902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:04.811205 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:04.822322 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:30:04.943093 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:30:05.061525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:05.568482 run create_hlr_db(pid=20497): Launched 09:30:05.693664 bus /sierra_2: Setting Powered False 09:30:06.757688 run create_hlr_db(pid=20497): Terminated: ok {rc=0} 09:30:07.192836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20499): Launched 09:30:07.496451 run osmo-hlr_10.42.42.2(pid=20500): Launched 09:30:07.613798 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:08.136626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20502): Launched 09:30:08.440439 run osmo-stp_10.42.42.5(pid=20503): Launched 09:30:08.557669 run osmo-msc_10.42.42.6: Starting osmo-msc 09:30:09.108194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20505): Launched 09:30:09.412647 run osmo-msc_10.42.42.6(pid=20506): Launched 09:30:09.583709 run osmo-stp_10.42.42.5(pid=20503): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20503)] 09:30:09.711719 run osmo-stp_10.42.42.5(pid=20503): stdout: | (launched: 2022-12-09_09:30:08.384226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:09.840004 run osmo-stp_10.42.42.5(pid=20503): stderr: | [0;m[38;5;43m20221209093008554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093008554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093008554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093008555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093008555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093008555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093008555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:09.966067 run osmo-stp_10.42.42.5(pid=20503): stdout: | (launched: 2022-12-09_09:30:08.384226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:10.087063 run osmo-stp_10.42.42.5(pid=20503): stderr: | [0;m[38;5;43m20221209093008554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093008554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093008554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093008555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093008555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093008555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093008555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:10.231674 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20503): Process ended prematurely: osmo-stp_10.42.42.5(pid=20503) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20503)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:30:10.240620 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:30:10.267312 run osmo-hlr_10.42.42.2(pid=20500): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20500)] 09:30:10.315037 run osmo-hlr_10.42.42.2(pid=20500): stdout: | (launched: 2022-12-09_09:30:07.440365) 09:30:10.364408 run osmo-hlr_10.42.42.2(pid=20500): stderr: | [0;m[1;31m20221209093007615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093007616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093007616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093007616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093007616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093007616 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093007628 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093007636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093007636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093007636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:10.433638 run osmo-msc_10.42.42.6(pid=20506): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20506)] 09:30:10.481317 run osmo-msc_10.42.42.6(pid=20506): stdout: | (launched: 2022-12-09_09:30:09.356114) 09:30:10.530623 run osmo-msc_10.42.42.6(pid=20506): stderr: | [0;m[38;5;43m20221209093009626 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093009626 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd201b3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093009627 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093009627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093009627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093009627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093009629 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093009629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093009629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093009629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:30:10.580731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20499): Terminating (SIGTERM) 09:30:10.620508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20502): Terminating (SIGTERM) 09:30:10.660174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20505): Terminating (SIGTERM) 09:30:10.700388 --- ParallelTerminationStrategy: PID 20499 died... 09:30:10.719774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20499): Terminated: ok {rc=0} 09:30:10.764010 --- ParallelTerminationStrategy: PID 20502 died... 09:30:10.782861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20502): Terminated: ok {rc=0} 09:30:10.826634 --- ParallelTerminationStrategy: PID 20505 died... 09:30:10.845391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20505): Terminated: ok {rc=0} 09:30:10.931407 bus /sierra_3: Setting Powered False 09:30:12.031858 bus /sierra_3: Setting Powered False 09:30:13.148131 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:30:14.298880 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:14.311493 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:30:14.381768 tst mo_mt_call_osmux.py: using LAC 20527 09:30:14.507318 tst mo_mt_call_osmux.py: using RAC 127 09:30:14.630631 tst mo_mt_call_osmux.py: using CellId 20527 09:30:14.748664 tst mo_mt_call_osmux.py: using BVCI 20528 09:30:14.858139 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:14.869602 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:14.880693 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:14.891937 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:14.903114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:30:14.914246 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:30:15.035118 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:30:15.155706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:15.627914 run create_hlr_db(pid=20508): Launched 09:30:15.750910 bus /sierra_2: Setting Powered False 09:30:16.816643 run create_hlr_db(pid=20508): Terminated: ok {rc=0} 09:30:17.280301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20510): Launched 09:30:17.607010 run osmo-hlr_10.42.42.2(pid=20511): Launched 09:30:17.731889 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:18.292816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20513): Launched 09:30:18.618465 run osmo-stp_10.42.42.5(pid=20514): Launched 09:30:18.743196 run osmo-msc_10.42.42.6: Starting osmo-msc 09:30:19.332891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20516): Launched 09:30:19.659511 run osmo-msc_10.42.42.6(pid=20517): Launched 09:30:19.841674 run osmo-stp_10.42.42.5(pid=20514): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20514)] 09:30:19.978875 run osmo-stp_10.42.42.5(pid=20514): stdout: | (launched: 2022-12-09_09:30:18.558605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:20.117362 run osmo-stp_10.42.42.5(pid=20514): stderr: | [0;m[38;5;43m20221209093018752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093018752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093018753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093018753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093018754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093018754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093018754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:20.254873 run osmo-stp_10.42.42.5(pid=20514): stdout: | (launched: 2022-12-09_09:30:18.558605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:20.385240 run osmo-stp_10.42.42.5(pid=20514): stderr: | [0;m[38;5;43m20221209093018752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093018752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093018753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093018753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093018754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093018754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093018754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:20.540695 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20514): Process ended prematurely: osmo-stp_10.42.42.5(pid=20514) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20514)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:30:20.550555 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:30:20.579279 run osmo-hlr_10.42.42.2(pid=20511): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20511)] 09:30:20.630172 run osmo-hlr_10.42.42.2(pid=20511): stdout: | (launched: 2022-12-09_09:30:17.546902) 09:30:20.682144 run osmo-hlr_10.42.42.2(pid=20511): stderr: | [0;m[1;31m20221209093017747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093017747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093017748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093017748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093017748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093017748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093017760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093017768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093017768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093017768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:20.754901 run osmo-msc_10.42.42.6(pid=20517): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20517)] 09:30:20.804731 run osmo-msc_10.42.42.6(pid=20517): stdout: | (launched: 2022-12-09_09:30:19.599129) 09:30:20.856550 run osmo-msc_10.42.42.6(pid=20517): stderr: | [0;m[38;5;43m20221209093019923 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093019923 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a38744c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093019923 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093019923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093019923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093019924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093019925 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093019926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093019926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093019926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:30:20.908630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20510): Terminating (SIGTERM) 09:30:20.950464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20513): Terminating (SIGTERM) 09:30:20.992758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20516): Terminating (SIGTERM) 09:30:21.035757 --- ParallelTerminationStrategy: PID 20510 died... 09:30:21.055799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20510): Terminated: ok {rc=0} 09:30:21.102600 --- ParallelTerminationStrategy: PID 20513 died... 09:30:21.122168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20513): Terminated: ok {rc=0} 09:30:21.168440 --- ParallelTerminationStrategy: PID 20516 died... 09:30:21.188070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20516): Terminated: ok {rc=0} 09:30:21.275746 bus /sierra_3: Setting Powered False 09:30:22.374139 bus /sierra_3: Setting Powered False 09:30:23.486690 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:30:24.749750 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:30:24.757898 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:30:24.793218 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:30:24.821635 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:30:24.875018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:30:24.909417 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:30:24.937735 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:30:25.496470 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:30:25.551035 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:25.563087 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:30:25.631350 tst mo_mt_call.py: using LAC 20528 09:30:25.758039 tst mo_mt_call.py: using RAC 128 09:30:25.883024 tst mo_mt_call.py: using CellId 20528 09:30:26.007792 tst mo_mt_call.py: using BVCI 20529 09:30:26.127103 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:26.139092 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:26.150950 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:26.163205 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:26.175525 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:26.187600 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:30:26.304649 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:30:26.426589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:26.931941 run create_hlr_db(pid=20522): Launched 09:30:27.055611 bus /sierra_2: Setting Powered False 09:30:28.120840 run create_hlr_db(pid=20522): Terminated: ok {rc=0} 09:30:28.573367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20524): Launched 09:30:28.898879 run osmo-hlr_10.42.42.2(pid=20525): Launched 09:30:29.023650 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:29.585629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20527): Launched 09:30:29.910437 run osmo-stp_10.42.42.5(pid=20528): Launched 09:30:30.035557 run osmo-msc_10.42.42.6: Starting osmo-msc 09:30:30.623969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20530): Launched 09:30:30.985726 run osmo-msc_10.42.42.6(pid=20531): Launched 09:30:31.298367 run osmo-stp_10.42.42.5(pid=20528): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20528)] 09:30:31.542746 run osmo-stp_10.42.42.5(pid=20528): stdout: | (launched: 2022-12-09_09:30:29.850929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:31.765195 run osmo-stp_10.42.42.5(pid=20528): stderr: | [0;m[38;5;43m20221209093030043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093030043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093030044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093030044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093030044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093030045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093030045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:31.940458 run osmo-stp_10.42.42.5(pid=20528): stdout: | (launched: 2022-12-09_09:30:29.850929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:32.067210 run osmo-stp_10.42.42.5(pid=20528): stderr: | [0;m[38;5;43m20221209093030043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093030043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093030044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093030044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093030044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093030045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093030045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:32.214957 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20528): Process ended prematurely: osmo-stp_10.42.42.5(pid=20528) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20528)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:30:32.224484 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 09:30:32.253394 run osmo-hlr_10.42.42.2(pid=20525): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20525)] 09:30:32.302858 run osmo-hlr_10.42.42.2(pid=20525): stdout: | (launched: 2022-12-09_09:30:28.839339) 09:30:32.353282 run osmo-hlr_10.42.42.2(pid=20525): stderr: | [0;m[1;31m20221209093029036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093029036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093029036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093029036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093029036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093029037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093029048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093029058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093029058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093029058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:32.423216 run osmo-msc_10.42.42.6(pid=20531): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20531)] 09:30:32.471326 run osmo-msc_10.42.42.6(pid=20531): stdout: | (launched: 2022-12-09_09:30:30.891148) 09:30:32.521651 run osmo-msc_10.42.42.6(pid=20531): stderr: | [0;m[38;5;43m20221209093031461 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093031461 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f42e82c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093031461 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093031461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093031462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093031462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093031464 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093031464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093031464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093031464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:30:32.571612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20524): Terminating (SIGTERM) 09:30:32.612022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20527): Terminating (SIGTERM) 09:30:32.652385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20530): Terminating (SIGTERM) 09:30:32.693079 --- ParallelTerminationStrategy: PID 20524 died... 09:30:32.712224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20524): Terminated: ok {rc=0} 09:30:32.758012 --- ParallelTerminationStrategy: PID 20527 died... 09:30:32.777175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20527): Terminated: ok {rc=0} 09:30:32.821570 --- ParallelTerminationStrategy: PID 20530 died... 09:30:32.840465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20530): Terminated: ok {rc=0} 09:30:32.927210 bus /sierra_3: Setting Powered False 09:30:34.027637 bus /sierra_3: Setting Powered False 09:30:35.145610 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:30:36.291992 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:36.303978 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:30:36.374410 tst mo_mt_call_osmux.py: using LAC 20529 09:30:36.493775 tst mo_mt_call_osmux.py: using RAC 129 09:30:36.621599 tst mo_mt_call_osmux.py: using CellId 20529 09:30:36.740125 tst mo_mt_call_osmux.py: using BVCI 20530 09:30:36.851067 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:36.862583 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:36.873986 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:36.885827 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:36.897682 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:30:36.909457 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:30:37.027204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:30:37.145867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:37.652511 run create_hlr_db(pid=20533): Launched 09:30:37.777920 bus /sierra_2: Setting Powered False 09:30:38.843006 run create_hlr_db(pid=20533): Terminated: ok {rc=0} 09:30:39.295311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20535): Launched 09:30:39.621561 run osmo-hlr_10.42.42.2(pid=20536): Launched 09:30:39.747063 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:40.311331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20538): Launched 09:30:40.637684 run osmo-stp_10.42.42.5(pid=20539): Launched 09:30:40.762826 run osmo-msc_10.42.42.6: Starting osmo-msc 09:30:41.353078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20541): Launched 09:30:41.658226 run osmo-msc_10.42.42.6(pid=20542): Launched 09:30:41.828301 run osmo-stp_10.42.42.5(pid=20539): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20539)] 09:30:41.956718 run osmo-stp_10.42.42.5(pid=20539): stdout: | (launched: 2022-12-09_09:30:40.577873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:42.086249 run osmo-stp_10.42.42.5(pid=20539): stderr: | [0;m[38;5;43m20221209093040771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093040771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093040772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093040772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093040773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093040773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093040773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:42.213152 run osmo-stp_10.42.42.5(pid=20539): stdout: | (launched: 2022-12-09_09:30:40.577873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:42.334524 run osmo-stp_10.42.42.5(pid=20539): stderr: | [0;m[38;5;43m20221209093040771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093040771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093040772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093040772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093040773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093040773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093040773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:42.479539 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20539): Process ended prematurely: osmo-stp_10.42.42.5(pid=20539) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20539)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:30:42.488710 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:30:42.515342 run osmo-hlr_10.42.42.2(pid=20536): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20536)] 09:30:42.562663 run osmo-hlr_10.42.42.2(pid=20536): stdout: | (launched: 2022-12-09_09:30:39.561718) 09:30:42.611686 run osmo-hlr_10.42.42.2(pid=20536): stderr: | [0;m[1;31m20221209093039762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093039762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093039762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093039762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093039762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093039762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093039774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093039785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093039785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093039785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:42.680377 run osmo-msc_10.42.42.6(pid=20542): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20542)] 09:30:42.727765 run osmo-msc_10.42.42.6(pid=20542): stdout: | (launched: 2022-12-09_09:30:41.601075) 09:30:42.776788 run osmo-msc_10.42.42.6(pid=20542): stderr: | [0;m[38;5;43m20221209093041874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093041874 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07e1390c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093041874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093041874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093041875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093041875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093041876 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093041877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093041877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093041877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:30:42.826494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20535): Terminating (SIGTERM) 09:30:42.866323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20538): Terminating (SIGTERM) 09:30:42.905593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20541): Terminating (SIGTERM) 09:30:42.945290 --- ParallelTerminationStrategy: PID 20535 died... 09:30:42.964270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20535): Terminated: ok {rc=0} 09:30:43.008223 --- ParallelTerminationStrategy: PID 20538 died... 09:30:43.027147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20538): Terminated: ok {rc=0} 09:30:43.070707 --- ParallelTerminationStrategy: PID 20541 died... 09:30:43.089442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20541): Terminated: ok {rc=0} 09:30:43.175030 bus /sierra_3: Setting Powered False 09:30:44.273837 bus /sierra_3: Setting Powered False 09:30:45.388544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:30:46.650962 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:30:46.664597 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:30:46.712501 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:30:46.751000 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:30:46.821616 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:30:46.868405 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:30:46.908208 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:30:47.436561 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:30:47.489474 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:47.501495 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:30:47.570984 tst mo_mt_call.py: using LAC 20530 09:30:47.698279 tst mo_mt_call.py: using RAC 130 09:30:47.827777 tst mo_mt_call.py: using CellId 20530 09:30:47.954745 tst mo_mt_call.py: using BVCI 20531 09:30:48.074268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:48.086066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:48.097746 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:48.109592 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:48.121656 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:48.133581 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:30:48.258011 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:30:48.379438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:48.883480 run create_hlr_db(pid=20547): Launched 09:30:49.007659 bus /sierra_2: Setting Powered False 09:30:50.071380 run create_hlr_db(pid=20547): Terminated: ok {rc=0} 09:30:50.505549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20549): Launched 09:30:50.808363 run osmo-hlr_10.42.42.2(pid=20550): Launched 09:30:50.924582 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:51.445151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20552): Launched 09:30:51.746985 run osmo-stp_10.42.42.5(pid=20553): Launched 09:30:51.862323 run osmo-msc_10.42.42.6: Starting osmo-msc 09:30:52.409888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20555): Launched 09:30:52.712914 run osmo-msc_10.42.42.6(pid=20556): Launched 09:30:52.883450 run osmo-stp_10.42.42.5(pid=20553): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20553)] 09:30:53.012822 run osmo-stp_10.42.42.5(pid=20553): stdout: | (launched: 2022-12-09_09:30:51.690880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:53.141481 run osmo-stp_10.42.42.5(pid=20553): stderr: | [0;m[38;5;43m20221209093051861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093051861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093051861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093051862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093051862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093051862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093051862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:53.267684 run osmo-stp_10.42.42.5(pid=20553): stdout: | (launched: 2022-12-09_09:30:51.690880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:53.388627 run osmo-stp_10.42.42.5(pid=20553): stderr: | [0;m[38;5;43m20221209093051861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093051861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093051861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093051862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093051862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093051862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093051862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:53.533542 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20553): Process ended prematurely: osmo-stp_10.42.42.5(pid=20553) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20553)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:30:53.542400 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:30:53.568934 run osmo-hlr_10.42.42.2(pid=20550): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20550)] 09:30:53.616284 run osmo-hlr_10.42.42.2(pid=20550): stdout: | (launched: 2022-12-09_09:30:50.752407) 09:30:53.665256 run osmo-hlr_10.42.42.2(pid=20550): stderr: | [0;m[1;31m20221209093050928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093050928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093050928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093050928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093050928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093050928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093050940 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093050949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093050949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093050949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:53.733970 run osmo-msc_10.42.42.6(pid=20556): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20556)] 09:30:53.781265 run osmo-msc_10.42.42.6(pid=20556): stdout: | (launched: 2022-12-09_09:30:52.656333) 09:30:53.830144 run osmo-msc_10.42.42.6(pid=20556): stderr: | [0;m[38;5;43m20221209093052927 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093052927 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a129fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093052927 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093052927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093052927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093052928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093052929 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093052930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093052930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093052930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:30:53.879439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20549): Terminating (SIGTERM) 09:30:53.918553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20552): Terminating (SIGTERM) 09:30:53.957817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20555): Terminating (SIGTERM) 09:30:53.997461 --- ParallelTerminationStrategy: PID 20549 died... 09:30:54.016499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20549): Terminated: ok {rc=0} 09:30:54.060480 --- ParallelTerminationStrategy: PID 20552 died... 09:30:54.078909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20552): Terminated: ok {rc=0} 09:30:54.122588 --- ParallelTerminationStrategy: PID 20555 died... 09:30:54.141236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20555): Terminated: ok {rc=0} 09:30:54.226866 bus /sierra_3: Setting Powered False 09:30:55.326797 bus /sierra_3: Setting Powered False 09:30:56.441964 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:30:57.588076 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:57.600083 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:30:57.666286 tst mo_mt_call_osmux.py: using LAC 20531 09:30:57.785460 tst mo_mt_call_osmux.py: using RAC 131 09:30:57.905101 tst mo_mt_call_osmux.py: using CellId 20531 09:30:58.022942 tst mo_mt_call_osmux.py: using BVCI 20532 09:30:58.134241 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:58.145720 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:58.157016 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:58.168232 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:58.179524 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:30:58.190874 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:30:58.305868 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:30:58.430251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:58.937097 run create_hlr_db(pid=20558): Launched 09:30:59.061787 bus /sierra_2: Setting Powered False 09:31:00.125630 run create_hlr_db(pid=20558): Terminated: ok {rc=0} 09:31:00.560252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20560): Launched 09:31:00.869714 run osmo-hlr_10.42.42.2(pid=20561): Launched 09:31:01.114777 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:01.817493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20563): Launched 09:31:02.186501 run osmo-stp_10.42.42.5(pid=20564): Launched 09:31:02.376169 run osmo-msc_10.42.42.6: Starting osmo-msc 09:31:02.976192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20566): Launched 09:31:03.302615 run osmo-msc_10.42.42.6(pid=20567): Launched 09:31:03.487160 run osmo-stp_10.42.42.5(pid=20564): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20564)] 09:31:03.624515 run osmo-stp_10.42.42.5(pid=20564): stdout: | (launched: 2022-12-09_09:31:02.121827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:03.762414 run osmo-stp_10.42.42.5(pid=20564): stderr: | [0;m[38;5;43m20221209093102393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093102393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093102393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093102394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093102394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093102394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093102394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:03.899740 run osmo-stp_10.42.42.5(pid=20564): stdout: | (launched: 2022-12-09_09:31:02.121827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:04.030190 run osmo-stp_10.42.42.5(pid=20564): stderr: | [0;m[38;5;43m20221209093102393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093102393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093102393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093102394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093102394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093102394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093102394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:04.185890 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20564): Process ended prematurely: osmo-stp_10.42.42.5(pid=20564) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20564)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:31:04.195642 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:31:04.224696 run osmo-hlr_10.42.42.2(pid=20561): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20561)] 09:31:04.275421 run osmo-hlr_10.42.42.2(pid=20561): stdout: | (launched: 2022-12-09_09:31:00.809114) 09:31:04.327291 run osmo-hlr_10.42.42.2(pid=20561): stderr: | [0;m[1;31m20221209093101141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093101141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093101141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093101141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093101141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093101141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093101163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093101180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093101180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093101180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:04.399926 run osmo-msc_10.42.42.6(pid=20567): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20567)] 09:31:04.450281 run osmo-msc_10.42.42.6(pid=20567): stdout: | (launched: 2022-12-09_09:31:03.242707) 09:31:04.502090 run osmo-msc_10.42.42.6(pid=20567): stderr: | [0;m[38;5;43m20221209093103564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093103564 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3efc50bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093103564 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093103565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093103565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093103565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093103567 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093103567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093103567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093103567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:31:04.554650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20560): Terminating (SIGTERM) 09:31:04.597102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20563): Terminating (SIGTERM) 09:31:04.639344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20566): Terminating (SIGTERM) 09:31:04.681990 --- ParallelTerminationStrategy: PID 20560 died... 09:31:04.701935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20560): Terminated: ok {rc=0} 09:31:04.748808 --- ParallelTerminationStrategy: PID 20563 died... 09:31:04.768772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20563): Terminated: ok {rc=0} 09:31:04.814919 --- ParallelTerminationStrategy: PID 20566 died... 09:31:04.834451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20566): Terminated: ok {rc=0} 09:31:04.922122 bus /sierra_3: Setting Powered False 09:31:06.018901 bus /sierra_3: Setting Powered False 09:31:07.135674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:31:08.388512 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:31:08.395870 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:31:08.428772 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:31:08.456016 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:31:08.508073 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:31:08.540493 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:31:08.567189 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:31:09.121922 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:31:09.175617 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:09.187674 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:31:09.256727 tst mo_mt_call.py: using LAC 20532 09:31:09.376048 tst mo_mt_call.py: using RAC 132 09:31:09.494093 tst mo_mt_call.py: using CellId 20532 09:31:09.612701 tst mo_mt_call.py: using BVCI 20533 09:31:09.723599 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:09.735161 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:09.746539 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:09.757917 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:09.769180 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:09.780343 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:31:09.900245 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:31:10.018513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:10.488878 run create_hlr_db(pid=20572): Launched 09:31:10.612766 bus /sierra_2: Setting Powered False 09:31:11.673673 run create_hlr_db(pid=20572): Terminated: ok {rc=0} 09:31:12.116196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20574): Launched 09:31:12.442230 run osmo-hlr_10.42.42.2(pid=20575): Launched 09:31:12.567360 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:13.126119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20577): Launched 09:31:13.452540 run osmo-stp_10.42.42.5(pid=20578): Launched 09:31:13.577638 run osmo-msc_10.42.42.6: Starting osmo-msc 09:31:14.164917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20580): Launched 09:31:14.490661 run osmo-msc_10.42.42.6(pid=20581): Launched 09:31:14.673316 run osmo-stp_10.42.42.5(pid=20578): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20578)] 09:31:14.811029 run osmo-stp_10.42.42.5(pid=20578): stdout: | (launched: 2022-12-09_09:31:13.392790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:14.948567 run osmo-stp_10.42.42.5(pid=20578): stderr: | [0;m[38;5;43m20221209093113586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093113586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093113587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093113587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093113588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093113588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093113588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:15.085489 run osmo-stp_10.42.42.5(pid=20578): stdout: | (launched: 2022-12-09_09:31:13.392790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:15.216087 run osmo-stp_10.42.42.5(pid=20578): stderr: | [0;m[38;5;43m20221209093113586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093113586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093113587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093113587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093113588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093113588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093113588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:15.371735 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20578): Process ended prematurely: osmo-stp_10.42.42.5(pid=20578) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20578)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:31:15.381549 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:31:15.410143 run osmo-hlr_10.42.42.2(pid=20575): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20575)] 09:31:15.460712 run osmo-hlr_10.42.42.2(pid=20575): stdout: | (launched: 2022-12-09_09:31:12.382712) 09:31:15.512643 run osmo-hlr_10.42.42.2(pid=20575): stderr: | [0;m[1;31m20221209093112582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093112582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093112582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093112582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093112582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093112582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093112594 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093112604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093112604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093112605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:15.585185 run osmo-msc_10.42.42.6(pid=20581): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20581)] 09:31:15.635432 run osmo-msc_10.42.42.6(pid=20581): stdout: | (launched: 2022-12-09_09:31:14.431009) 09:31:15.687281 run osmo-msc_10.42.42.6(pid=20581): stderr: | [0;m[38;5;43m20221209093114751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093114751 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f779ae8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093114751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093114751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093114752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093114752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093114753 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093114754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093114754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093114754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:31:15.739367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20574): Terminating (SIGTERM) 09:31:15.781539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20577): Terminating (SIGTERM) 09:31:15.824210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20580): Terminating (SIGTERM) 09:31:15.884305 --- ParallelTerminationStrategy: PID 20574 died... 09:31:15.906142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20574): Terminated: ok {rc=0} 09:31:15.957914 --- ParallelTerminationStrategy: PID 20577 died... 09:31:15.978608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20577): Terminated: ok {rc=0} 09:31:16.026921 --- ParallelTerminationStrategy: PID 20580 died... 09:31:16.047451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20580): Terminated: ok {rc=0} 09:31:16.136892 bus /sierra_3: Setting Powered False 09:31:17.244929 bus /sierra_3: Setting Powered False 09:31:18.362201 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:31:19.510078 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:19.522702 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:31:19.592815 tst mo_mt_call_osmux.py: using LAC 20533 09:31:19.719983 tst mo_mt_call_osmux.py: using RAC 133 09:31:19.849346 tst mo_mt_call_osmux.py: using CellId 20533 09:31:19.972598 tst mo_mt_call_osmux.py: using BVCI 20534 09:31:20.084583 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:20.096152 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:20.107738 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:20.119578 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:20.131494 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:31:20.143197 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:31:20.264142 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:31:20.383118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:20.887414 run create_hlr_db(pid=20583): Launched 09:31:21.011633 bus /sierra_2: Setting Powered False 09:31:22.075591 run create_hlr_db(pid=20583): Terminated: ok {rc=0} 09:31:22.509185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20585): Launched 09:31:22.813915 run osmo-hlr_10.42.42.2(pid=20586): Launched 09:31:22.929552 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:23.468029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20588): Launched 09:31:23.771625 run osmo-stp_10.42.42.5(pid=20589): Launched 09:31:23.887479 run osmo-msc_10.42.42.6: Starting osmo-msc 09:31:24.435960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20591): Launched 09:31:24.739588 run osmo-msc_10.42.42.6(pid=20592): Launched 09:31:24.909489 run osmo-stp_10.42.42.5(pid=20589): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20589)] 09:31:25.037154 run osmo-stp_10.42.42.5(pid=20589): stdout: | (launched: 2022-12-09_09:31:23.715510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:25.165520 run osmo-stp_10.42.42.5(pid=20589): stderr: | [0;m[38;5;43m20221209093123885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093123885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093123885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093123886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093123886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093123886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093123886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:25.292387 run osmo-stp_10.42.42.5(pid=20589): stdout: | (launched: 2022-12-09_09:31:23.715510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:25.413496 run osmo-stp_10.42.42.5(pid=20589): stderr: | [0;m[38;5;43m20221209093123885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093123885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093123885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093123886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093123886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093123886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093123886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:25.558646 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20589): Process ended prematurely: osmo-stp_10.42.42.5(pid=20589) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20589)] [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:31:25.567792 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:31:25.594432 run osmo-hlr_10.42.42.2(pid=20586): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20586)] 09:31:25.641983 run osmo-hlr_10.42.42.2(pid=20586): stdout: | (launched: 2022-12-09_09:31:22.757540) 09:31:25.691000 run osmo-hlr_10.42.42.2(pid=20586): stderr: | [0;m[1;31m20221209093122935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093122935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093122935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093122935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093122935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093122935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093122947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093122958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093122958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093122958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:25.759730 run osmo-msc_10.42.42.6(pid=20592): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20592)] 09:31:25.807026 run osmo-msc_10.42.42.6(pid=20592): stdout: | (launched: 2022-12-09_09:31:24.683421) 09:31:25.855918 run osmo-msc_10.42.42.6(pid=20592): stderr: | [0;m[38;5;43m20221209093124954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093124954 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0c838cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093124954 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093124954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093124955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093124955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093124957 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093124957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093124957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093124957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:31:25.905252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20585): Terminating (SIGTERM) 09:31:25.944876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20588): Terminating (SIGTERM) 09:31:25.984460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20591): Terminating (SIGTERM) 09:31:26.024480 --- ParallelTerminationStrategy: PID 20585 died... 09:31:26.043670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20585): Terminated: ok {rc=0} 09:31:26.087552 --- ParallelTerminationStrategy: PID 20588 died... 09:31:26.106209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20588): Terminated: ok {rc=0} 09:31:26.149666 --- ParallelTerminationStrategy: PID 20591 died... 09:31:26.168323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20591): Terminated: ok {rc=0} 09:31:26.250685 bus /sierra_3: Setting Powered False 09:31:27.345507 bus /sierra_3: Setting Powered False 09:31:28.458420 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:31:29.715739 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:31:29.723925 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:31:29.759042 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:31:29.787104 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:31:29.840667 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:31:29.874850 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:31:29.902999 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:31:30.457215 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:31:30.509464 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:30.521416 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:31:30.591558 tst mo_mt_call.py: using LAC 20534 09:31:30.719648 tst mo_mt_call.py: using RAC 134 09:31:30.851391 tst mo_mt_call.py: using CellId 20534 09:31:30.987111 tst mo_mt_call.py: using BVCI 20535 09:31:31.109893 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:31.122985 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:31.136861 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:31.150755 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:31.164748 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:31.177863 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:31:31.303524 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:31:31.463822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:31.993535 run create_hlr_db(pid=20598): Launched 09:31:32.151335 bus /sierra_2: Setting Powered False 09:31:33.212285 run create_hlr_db(pid=20598): Terminated: ok {rc=0} 09:31:33.638842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20600): Launched 09:31:33.944822 run osmo-hlr_10.42.42.2(pid=20601): Launched 09:31:34.060862 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:34.587019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20603): Launched 09:31:34.890074 run osmo-stp_10.42.42.5(pid=20604): Launched 09:31:35.005739 run osmo-msc_10.42.42.6: Starting osmo-msc 09:31:35.553388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20606): Launched 09:31:35.856233 run osmo-msc_10.42.42.6(pid=20607): Launched 09:31:36.025187 run osmo-stp_10.42.42.5(pid=20604): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20604)] 09:31:36.153234 run osmo-stp_10.42.42.5(pid=20604): stdout: | (launched: 2022-12-09_09:31:34.834240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:36.280701 run osmo-stp_10.42.42.5(pid=20604): stderr: | [0;m[38;5;43m20221209093135002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093135002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093135003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093135003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093135004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093135004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093135004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:36.406705 run osmo-stp_10.42.42.5(pid=20604): stdout: | (launched: 2022-12-09_09:31:34.834240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:36.527694 run osmo-stp_10.42.42.5(pid=20604): stderr: | [0;m[38;5;43m20221209093135002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093135002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093135003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093135003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093135004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093135004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093135004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:36.672192 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20604): Process ended prematurely: osmo-stp_10.42.42.5(pid=20604) [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20604)] [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:31:36.681393 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:31:36.708062 run osmo-hlr_10.42.42.2(pid=20601): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20601)] 09:31:36.755750 run osmo-hlr_10.42.42.2(pid=20601): stdout: | (launched: 2022-12-09_09:31:33.888714) 09:31:36.805244 run osmo-hlr_10.42.42.2(pid=20601): stderr: | [0;m[1;31m20221209093134066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093134066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093134066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093134066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093134066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093134066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093134078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093134087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093134087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093134087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:36.874181 run osmo-msc_10.42.42.6(pid=20607): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20607)] 09:31:36.921633 run osmo-msc_10.42.42.6(pid=20607): stdout: | (launched: 2022-12-09_09:31:35.800369) 09:31:36.970273 run osmo-msc_10.42.42.6(pid=20607): stderr: | [0;m[38;5;43m20221209093136073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093136073 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12ae756c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093136073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093136073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093136074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093136075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093136077 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093136077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093136077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093136077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:31:37.019505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20600): Terminating (SIGTERM) 09:31:37.059353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20603): Terminating (SIGTERM) 09:31:37.099243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20606): Terminating (SIGTERM) 09:31:37.139375 --- ParallelTerminationStrategy: PID 20600 died... 09:31:37.158577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20600): Terminated: ok {rc=0} 09:31:37.202774 --- ParallelTerminationStrategy: PID 20603 died... 09:31:37.221480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20603): Terminated: ok {rc=0} 09:31:37.265730 --- ParallelTerminationStrategy: PID 20606 died... 09:31:37.284648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20606): Terminated: ok {rc=0} 09:31:37.370517 bus /sierra_3: Setting Powered False 09:31:38.470906 bus /sierra_3: Setting Powered False 09:31:39.585126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:31:40.734221 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:40.746920 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:31:40.817361 tst mo_mt_call_osmux.py: using LAC 20535 09:31:40.946695 tst mo_mt_call_osmux.py: using RAC 135 09:31:41.073913 tst mo_mt_call_osmux.py: using CellId 20535 09:31:41.202434 tst mo_mt_call_osmux.py: using BVCI 20536 09:31:41.320929 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:41.333245 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:41.345288 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:41.357247 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:41.369400 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:31:41.381503 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:31:41.503115 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:31:41.622902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:42.096866 run create_hlr_db(pid=20610): Launched 09:31:42.221539 bus /sierra_2: Setting Powered False 09:31:43.282155 run create_hlr_db(pid=20610): Terminated: ok {rc=0} 09:31:43.726550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20612): Launched 09:31:44.052538 run osmo-hlr_10.42.42.2(pid=20613): Launched 09:31:44.177319 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:44.710277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20615): Launched 09:31:45.013931 run osmo-stp_10.42.42.5(pid=20616): Launched 09:31:45.131229 run osmo-msc_10.42.42.6: Starting osmo-msc 09:31:45.679717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20618): Launched 09:31:45.999931 run osmo-msc_10.42.42.6(pid=20619): Launched 09:31:46.421412 run osmo-stp_10.42.42.5(pid=20616): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20616)] 09:31:46.660405 run osmo-stp_10.42.42.5(pid=20616): stdout: | (launched: 2022-12-09_09:31:44.957501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:46.898121 run osmo-stp_10.42.42.5(pid=20616): stderr: | [0;m[38;5;43m20221209093145127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093145127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093145127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093145128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093145128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093145128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093145128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:47.026444 run osmo-stp_10.42.42.5(pid=20616): stdout: | (launched: 2022-12-09_09:31:44.957501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:47.149850 run osmo-stp_10.42.42.5(pid=20616): stderr: | [0;m[38;5;43m20221209093145127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093145127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093145127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093145128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093145128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093145128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093145128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:47.336713 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20616): Process ended prematurely: osmo-stp_10.42.42.5(pid=20616) [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20616)] [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:31:47.346678 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 09:31:47.374533 run osmo-hlr_10.42.42.2(pid=20613): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20613)] 09:31:47.423104 run osmo-hlr_10.42.42.2(pid=20613): stdout: | (launched: 2022-12-09_09:31:43.993162) 09:31:47.472885 run osmo-hlr_10.42.42.2(pid=20613): stderr: | [0;m[1;31m20221209093144190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093144190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093144190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093144190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093144190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093144190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093144206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093144215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093144216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093144216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:47.541779 run osmo-msc_10.42.42.6(pid=20619): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20619)] 09:31:47.589148 run osmo-msc_10.42.42.6(pid=20619): stdout: | (launched: 2022-12-09_09:31:45.939668) 09:31:47.637947 run osmo-msc_10.42.42.6(pid=20619): stderr: | [0;m[38;5;43m20221209093146480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093146480 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2fa59efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093146480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093146480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093146480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093146480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093146490 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093146492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093146493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093146493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:31:47.687366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20612): Terminating (SIGTERM) 09:31:47.726867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20615): Terminating (SIGTERM) 09:31:47.766380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20618): Terminating (SIGTERM) 09:31:47.806313 --- ParallelTerminationStrategy: PID 20612 died... 09:31:47.825355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20612): Terminated: ok {rc=0} 09:31:47.869538 --- ParallelTerminationStrategy: PID 20615 died... 09:31:47.888081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20615): Terminated: ok {rc=0} 09:31:47.932028 --- ParallelTerminationStrategy: PID 20618 died... 09:31:47.950793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20618): Terminated: ok {rc=0} 09:31:48.036220 bus /sierra_3: Setting Powered False 09:31:49.133766 bus /sierra_3: Setting Powered False 09:31:50.247992 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:31:51.505952 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:31:51.513988 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:31:51.546385 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 09:31:51.573313 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 09:31:51.626300 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:31:51.659423 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 09:31:51.686895 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 09:31:52.239797 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 09:31:52.288332 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:31:52.300092 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:31:52.350445 tst mo_mt_call.py: using LAC 20536 09:31:52.472014 tst mo_mt_call.py: using RAC 136 09:31:52.591194 tst mo_mt_call.py: using CellId 20536 09:31:52.708843 tst mo_mt_call.py: using BVCI 20537 09:31:52.818608 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:31:52.830384 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:31:52.841748 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:31:52.853177 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:31:52.864531 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:31:52.875917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:31:52.994929 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:31:53.115283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:53.623622 run create_hlr_db(pid=20624): Launched 09:31:53.747914 bus /sierra_2: Setting Powered False 09:31:54.813152 run create_hlr_db(pid=20624): Terminated: ok {rc=0} 09:31:55.247464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20626): Launched 09:31:55.551920 run osmo-hlr_10.42.42.2(pid=20627): Launched 09:31:55.668937 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:56.190109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20629): Launched 09:31:56.492732 run osmo-stp_10.42.42.5(pid=20630): Launched 09:31:56.608352 run osmo-msc_10.42.42.6: Starting osmo-msc 09:31:57.156624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20632): Launched 09:31:57.483086 run osmo-msc_10.42.42.6(pid=20633): Launched 09:31:57.666860 run osmo-stp_10.42.42.5(pid=20630): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20630)] 09:31:57.804282 run osmo-stp_10.42.42.5(pid=20630): stdout: | (launched: 2022-12-09_09:31:56.436477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:57.942391 run osmo-stp_10.42.42.5(pid=20630): stderr: | [0;m[38;5;43m20221209093156607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093156607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093156607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093156607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093156608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093156608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093156608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:58.071826 run osmo-stp_10.42.42.5(pid=20630): stdout: | (launched: 2022-12-09_09:31:56.436477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:58.192570 run osmo-stp_10.42.42.5(pid=20630): stderr: | [0;m[38;5;43m20221209093156607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093156607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093156607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093156607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093156608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093156608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093156608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:58.337351 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20630): Process ended prematurely: osmo-stp_10.42.42.5(pid=20630) [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20630)] [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 09:31:58.346483 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:31:58.373264 run osmo-hlr_10.42.42.2(pid=20627): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20627)] 09:31:58.421222 run osmo-hlr_10.42.42.2(pid=20627): stdout: | (launched: 2022-12-09_09:31:55.495591) 09:31:58.471058 run osmo-hlr_10.42.42.2(pid=20627): stderr: | [0;m[1;31m20221209093155674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093155674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093155674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093155674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093155674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093155674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093155691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093155701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093155701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093155701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:58.541424 run osmo-msc_10.42.42.6(pid=20633): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20633)] 09:31:58.589393 run osmo-msc_10.42.42.6(pid=20633): stdout: | (launched: 2022-12-09_09:31:57.423438) 09:31:58.639023 run osmo-msc_10.42.42.6(pid=20633): stderr: | [0;m[38;5;43m20221209093157743 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093157744 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a3ad38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093157744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093157744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093157744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093157744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093157746 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093157746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093157746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093157746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:31:58.689311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20626): Terminating (SIGTERM) 09:31:58.729569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20629): Terminating (SIGTERM) 09:31:58.769734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20632): Terminating (SIGTERM) 09:31:58.810056 --- ParallelTerminationStrategy: PID 20626 died... 09:31:58.829464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20626): Terminated: ok {rc=0} 09:31:58.873979 --- ParallelTerminationStrategy: PID 20629 died... 09:31:58.893205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20629): Terminated: ok {rc=0} 09:31:58.937398 --- ParallelTerminationStrategy: PID 20632 died... 09:31:58.956090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20632): Terminated: ok {rc=0} 09:31:59.040701 bus /sierra_3: Setting Powered False 09:32:00.138503 bus /sierra_3: Setting Powered False 09:32:01.254746 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 09:32:02.398683 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:32:02.411204 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:32:02.467638 tst mo_mt_call_osmux.py: using LAC 20537 09:32:02.591992 tst mo_mt_call_osmux.py: using RAC 137 09:32:02.711912 tst mo_mt_call_osmux.py: using CellId 20537 09:32:02.833487 tst mo_mt_call_osmux.py: using BVCI 20538 09:32:02.945046 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:32:02.956794 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:32:02.968489 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:32:02.979917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:32:02.991565 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:32:03.003133 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:32:03.120698 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:32:03.242641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:03.748608 run create_hlr_db(pid=20635): Launched 09:32:03.873333 bus /sierra_2: Setting Powered False 09:32:04.937548 run create_hlr_db(pid=20635): Terminated: ok {rc=0} 09:32:05.372736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20637): Launched 09:32:05.677754 run osmo-hlr_10.42.42.2(pid=20638): Launched 09:32:05.794043 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:06.316908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20640): Launched 09:32:06.622391 run osmo-stp_10.42.42.5(pid=20641): Launched 09:32:06.738242 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:07.287539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20643): Launched 09:32:07.592575 run osmo-msc_10.42.42.6(pid=20644): Launched 09:32:07.763800 run osmo-stp_10.42.42.5(pid=20641): ERR: Terminated: ERROR {rc=1} [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20641)] 09:32:07.891986 run osmo-stp_10.42.42.5(pid=20641): stdout: | (launched: 2022-12-09_09:32:06.565649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:08.020190 run osmo-stp_10.42.42.5(pid=20641): stderr: | [0;m[38;5;43m20221209093206738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093206738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093206738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093206739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093206739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093206739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093206739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:08.146889 run osmo-stp_10.42.42.5(pid=20641): stdout: | (launched: 2022-12-09_09:32:06.565649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:08.268246 run osmo-stp_10.42.42.5(pid=20641): stderr: | [0;m[38;5;43m20221209093206738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093206738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093206738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093206739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093206739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093206739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093206739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:08.413987 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20641): Process ended prematurely: osmo-stp_10.42.42.5(pid=20641) [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20641)] [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 09:32:08.423148 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:32:08.450295 run osmo-hlr_10.42.42.2(pid=20638): ERR: Terminated: ERROR {rc=237} [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20638)] 09:32:08.498389 run osmo-hlr_10.42.42.2(pid=20638): stdout: | (launched: 2022-12-09_09:32:05.621390) 09:32:08.548000 run osmo-hlr_10.42.42.2(pid=20638): stderr: | [0;m[1;31m20221209093205796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093205796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093205796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093205796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093205796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093205796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093205808 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093205817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093205817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093205817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:08.617616 run osmo-msc_10.42.42.6(pid=20644): ERR: Terminated: ERROR {rc=2} [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20644)] 09:32:08.665415 run osmo-msc_10.42.42.6(pid=20644): stdout: | (launched: 2022-12-09_09:32:07.535937) 09:32:08.714761 run osmo-msc_10.42.42.6(pid=20644): stderr: | [0;m[38;5;43m20221209093207808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093207808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09e4b51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093207808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093207808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093207808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093207809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093207810 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093207811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093207811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093207811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:08.764825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20637): Terminating (SIGTERM) 09:32:08.805105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20640): Terminating (SIGTERM) 09:32:08.845299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20643): Terminating (SIGTERM) 09:32:08.886138 --- ParallelTerminationStrategy: PID 20637 died... 09:32:08.905398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20637): Terminated: ok {rc=0} 09:32:08.949370 --- ParallelTerminationStrategy: PID 20640 died... 09:32:08.967944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20640): Terminated: ok {rc=0} 09:32:09.012094 --- ParallelTerminationStrategy: PID 20643 died... 09:32:09.030789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20643): Terminated: ok {rc=0} 09:32:09.115723 bus /sierra_3: Setting Powered False 09:32:10.219029 bus /sierra_3: Setting Powered False 09:32:11.336610 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 emergency:nanobts+band-900 --------------------------------------------------------------------- 09:32:12.596528 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:12.602499 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:32:12.637529 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:32:12.666072 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:32:12.754209 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:32:12.788013 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:32:12.815996 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:32:13.403740 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2357 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 09:32:13.409413 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:13.420778 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:32:13.473354 tst emergency_mo_mt_call.py: using LAC 20538 09:32:13.601127 tst emergency_mo_mt_call.py: using RAC 138 09:32:13.727497 tst emergency_mo_mt_call.py: using CellId 20538 09:32:13.852065 tst emergency_mo_mt_call.py: using BVCI 20539 09:32:13.967711 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:13.979099 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:13.990266 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:14.001846 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:14.013624 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:14.025524 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:14.143023 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:14.263188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:14.727559 run create_hlr_db(pid=20649): Launched 09:32:14.850637 bus /sierra_2: Setting Powered False 09:32:15.923269 run create_hlr_db(pid=20649): Terminated: ok {rc=0} 09:32:16.405685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Launched 09:32:16.761623 run osmo-hlr_10.42.42.2(pid=20652): Launched 09:32:17.019446 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:17.632303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Launched 09:32:17.951494 run osmo-stp_10.42.42.5(pid=20655): Launched 09:32:18.082722 tst emergency_mo_mt_call.py: using MSISDN 7133 09:32:18.248720 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:18.823639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20657): Launched 09:32:19.145201 run osmo-msc_10.42.42.6(pid=20658): Launched 09:32:19.323702 run osmo-stp_10.42.42.5(pid=20655): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] 09:32:19.459764 run osmo-stp_10.42.42.5(pid=20655): stdout: | (launched: 2022-12-09_09:32:17.892513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:19.595543 run osmo-stp_10.42.42.5(pid=20655): stderr: | [0;m[38;5;43m20221209093218084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093218084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093218084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093218085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093218085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093218085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093218085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:19.730506 run osmo-stp_10.42.42.5(pid=20655): stdout: | (launched: 2022-12-09_09:32:17.892513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:19.858172 run osmo-stp_10.42.42.5(pid=20655): stderr: | [0;m[38;5;43m20221209093218084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093218084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093218084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093218085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093218085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093218085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093218085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:20.010410 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20655): Process ended prematurely: osmo-stp_10.42.42.5(pid=20655) [trial-2357↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] [trial-2357↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 09:32:20.019717 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 09:32:20.048239 run osmo-hlr_10.42.42.2(pid=20652): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20652)] 09:32:20.099131 run osmo-hlr_10.42.42.2(pid=20652): stdout: | (launched: 2022-12-09_09:32:16.678082) 09:32:20.151263 run osmo-hlr_10.42.42.2(pid=20652): stderr: | [0;m[1;31m20221209093217006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093217006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093217006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093217007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093217007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093217007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093217022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093217038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093217039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093217039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:20.224041 run osmo-msc_10.42.42.6(pid=20658): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20658)] 09:32:20.275146 run osmo-msc_10.42.42.6(pid=20658): stdout: | (launched: 2022-12-09_09:32:19.084697) 09:32:20.327644 run osmo-msc_10.42.42.6(pid=20658): stderr: | [0;m[38;5;43m20221209093219406 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093219406 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5caa511c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093219406 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093219406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093219406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093219407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093219408 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093219409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093219409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093219409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:20.380177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Terminating (SIGTERM) 09:32:20.422745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Terminating (SIGTERM) 09:32:20.465216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20657): Terminating (SIGTERM) 09:32:20.507702 --- ParallelTerminationStrategy: PID 20651 died... 09:32:20.527811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Terminated: ok {rc=0} 09:32:20.574727 --- ParallelTerminationStrategy: PID 20654 died... 09:32:20.594491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Terminated: ok {rc=0} 09:32:20.641326 --- ParallelTerminationStrategy: PID 20657 died... 09:32:20.661202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20657): Terminated: ok {rc=0} 09:32:20.750235 bus /sierra_3: Setting Powered False 09:32:21.850366 bus /sierra_3: Setting Powered False 09:32:22.967192 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 09:32:24.053921 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:24.066126 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:32:24.118309 tst emergency_preemptive_call.py: using LAC 20539 09:32:24.245376 tst emergency_preemptive_call.py: using RAC 139 09:32:24.370713 tst emergency_preemptive_call.py: using CellId 20539 09:32:24.496775 tst emergency_preemptive_call.py: using BVCI 20540 09:32:24.612544 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:24.623981 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:24.635122 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:24.646698 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:24.658229 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:32:24.669903 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:24.789563 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:24.909793 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:25.025062 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:25.142808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:25.607380 run create_hlr_db(pid=20660): Launched 09:32:25.730763 bus /sierra_2: Setting Powered False 09:32:26.791121 run create_hlr_db(pid=20660): Terminated: ok {rc=0} 09:32:27.228909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20662): Launched 09:32:27.550458 run osmo-hlr_10.42.42.2(pid=20663): Launched 09:32:27.673488 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:28.227292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20665): Launched 09:32:28.548034 run osmo-stp_10.42.42.5(pid=20666): Launched 09:32:28.680165 tst emergency_preemptive_call.py: using MSISDN 7134 09:32:28.847921 run osmo-msc_10.42.42.6: Starting osmo-msc 09:32:29.421195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20668): Launched 09:32:29.745710 run osmo-msc_10.42.42.6(pid=20669): Launched 09:32:29.916318 run osmo-stp_10.42.42.5(pid=20666): ERR: Terminated: ERROR {rc=1} [trial-2357↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20666)] 09:32:30.045403 run osmo-stp_10.42.42.5(pid=20666): stdout: | (launched: 2022-12-09_09:32:28.488880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:30.173702 run osmo-stp_10.42.42.5(pid=20666): stderr: | [0;m[38;5;43m20221209093228681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093228681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093228682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093228682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093228683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093228683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093228683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:30.298727 run osmo-stp_10.42.42.5(pid=20666): stdout: | (launched: 2022-12-09_09:32:28.488880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:30.417344 run osmo-stp_10.42.42.5(pid=20666): stderr: | [0;m[38;5;43m20221209093228681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093228681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093228682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093228682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093228683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093228683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093228683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:30.558812 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20666): Process ended prematurely: osmo-stp_10.42.42.5(pid=20666) [trial-2357↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20666)] [trial-2357↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 09:32:30.567167 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 09:32:30.593340 run osmo-hlr_10.42.42.2(pid=20663): ERR: Terminated: ERROR {rc=237} [trial-2357↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20663)] 09:32:30.641154 run osmo-hlr_10.42.42.2(pid=20663): stdout: | (launched: 2022-12-09_09:32:27.491198) 09:32:30.690309 run osmo-hlr_10.42.42.2(pid=20663): stderr: | [0;m[1;31m20221209093227690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093227690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093227690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093227691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093227691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093227691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093227703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093227712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093227712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093227712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:30.759472 run osmo-msc_10.42.42.6(pid=20669): ERR: Terminated: ERROR {rc=2} [trial-2357↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20669)] 09:32:30.807190 run osmo-msc_10.42.42.6(pid=20669): stdout: | (launched: 2022-12-09_09:32:29.682434) 09:32:30.860830 run osmo-msc_10.42.42.6(pid=20669): stderr: | [0;m[38;5;43m20221209093229961 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093229961 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f878d67bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093229961 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093229961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093229961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093229962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093229963 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093229964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093229964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093229964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:32:30.918036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20662): Terminating (SIGTERM) 09:32:30.960475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20665): Terminating (SIGTERM) 09:32:31.004397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20668): Terminating (SIGTERM) 09:32:31.048684 --- ParallelTerminationStrategy: PID 20662 died... 09:32:31.068777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20662): Terminated: ok {rc=0} 09:32:31.115834 --- ParallelTerminationStrategy: PID 20665 died... 09:32:31.135325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20665): Terminated: ok {rc=0} 09:32:31.180113 --- ParallelTerminationStrategy: PID 20668 died... 09:32:31.199481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20668): Terminated: ok {rc=0} 09:32:31.286243 bus /sierra_9: Setting Powered False 09:32:32.388323 bus /sierra_9: Setting Powered False 09:32:33.505982 bus /sierra_8: Setting Powered False 09:32:34.605576 bus /sierra_8: Setting Powered False 09:32:35.724299 bus /sierra_3: Setting Powered False 09:32:36.824449 bus /sierra_3: Setting Powered False 09:32:37.939645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900 --------------------------------------------------------------------- 09:32:39.227179 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:39.232906 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:32:39.267964 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 09:32:39.308812 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:32:39.399828 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:32:39.433687 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 09:32:39.474186 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:32:40.070201 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 09:32:40.123720 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.135053 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:32:40.184703 tst cs_paging_gprs_active.py: using LAC 20540 09:32:40.306625 tst cs_paging_gprs_active.py: using RAC 140 09:32:40.428738 tst cs_paging_gprs_active.py: using CellId 20540 09:32:40.549394 tst cs_paging_gprs_active.py: using BVCI 20541 09:32:40.662730 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.674143 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.684941 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.695763 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.706529 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.717406 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.728303 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.739020 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:40.749938 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:40.869652 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:40.993797 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:32:41.215163 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:41.543769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20674): Launched 09:32:41.828504 run iperf3-srv_10.42.42.10(pid=20675): Launched 09:32:41.951134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:32:42.170958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:42.499315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20676): Launched 09:32:42.782396 run iperf3-srv_10.42.42.10(pid=20677): Launched 09:32:42.903891 tst cs_paging_gprs_active.py:38: start network... 09:32:43.123086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:43.628497 run create_hlr_db(pid=20678): Launched 09:32:43.753638 bus /sierra_2: Setting Powered False 09:32:44.818335 run create_hlr_db(pid=20678): Terminated: ok {rc=0} 09:32:45.271031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20680): Launched 09:32:45.597870 run osmo-hlr_10.42.42.2(pid=20681): Launched 09:32:45.722472 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:46.328596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20683): Launched 09:32:46.671494 run osmo-stp_10.42.42.5(pid=20684): Launched 09:32:46.918309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:47.558449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20686): Launched 09:32:47.683426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:47.958921 run patchelf(pid=20687): Launched 09:32:48.139617 run osmo-stp_10.42.42.5(pid=20684): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20684)] 09:32:48.277552 run osmo-stp_10.42.42.5(pid=20684): stdout: | (launched: 2022-12-09_09:32:46.609476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:48.416714 run osmo-stp_10.42.42.5(pid=20684): stderr: | [0;m[38;5;43m20221209093246907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093246907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093246907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093246908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093246908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093246908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093246908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:48.555626 run osmo-stp_10.42.42.5(pid=20684): stdout: | (launched: 2022-12-09_09:32:46.609476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:48.688757 run osmo-stp_10.42.42.5(pid=20684): stderr: | [0;m[38;5;43m20221209093246907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093246907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093246907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093246908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093246908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093246908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093246908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:48.846660 run patchelf(pid=20687): Terminating (SIGINT) 09:32:49.028809 run patchelf(pid=20687): Terminated: ok {rc=0} 09:32:49.160215 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20684): Process ended prematurely: osmo-stp_10.42.42.5(pid=20684) [trial-2357↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20684)] [trial-2357↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 09:32:49.170471 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 09:32:49.199468 run osmo-hlr_10.42.42.2(pid=20681): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20681)] 09:32:49.249408 run osmo-hlr_10.42.42.2(pid=20681): stdout: | (launched: 2022-12-09_09:32:45.537766) 09:32:49.301591 run osmo-hlr_10.42.42.2(pid=20681): stderr: | [0;m[1;31m20221209093245737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093245737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093245737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093245737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093245737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093245737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093245750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093245758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093245759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093245759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:49.353791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20674): Terminating (SIGTERM) 09:32:49.395614 run iperf3-srv_10.42.42.10(pid=20675): Terminating (SIGTERM) 09:32:49.437405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20676): Terminating (SIGTERM) 09:32:49.479221 run iperf3-srv_10.42.42.10(pid=20677): Terminating (SIGTERM) 09:32:49.520934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20680): Terminating (SIGTERM) 09:32:49.562798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20683): Terminating (SIGTERM) 09:32:49.604523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20686): Terminating (SIGTERM) 09:32:49.646730 --- ParallelTerminationStrategy: PID 20674 died... 09:32:49.666788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20674): Terminated: ok {rc=0} 09:32:49.713136 --- ParallelTerminationStrategy: PID 20675 died... 09:32:49.732280 run iperf3-srv_10.42.42.10(pid=20675): Terminated {rc=256} 09:32:49.778698 --- ParallelTerminationStrategy: PID 20676 died... 09:32:49.798133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20676): Terminated: ok {rc=0} 09:32:49.844343 --- ParallelTerminationStrategy: PID 20677 died... 09:32:49.863795 run iperf3-srv_10.42.42.10(pid=20677): Terminated {rc=256} 09:32:49.910257 --- ParallelTerminationStrategy: PID 20680 died... 09:32:49.929621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20680): Terminated: ok {rc=0} 09:32:49.975656 --- ParallelTerminationStrategy: PID 20683 died... 09:32:49.995090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20683): Terminated: ok {rc=0} 09:32:50.041885 --- ParallelTerminationStrategy: PID 20686 died... 09:32:50.061664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20686): Terminated: ok {rc=0} 09:32:50.149845 bus /gobi_0: Setting Powered False 09:32:51.249064 bus /gobi_0: Setting Powered False 09:32:52.368250 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 09:32:53.514614 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:53.526026 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:32:53.576560 tst iperf3.py: using LAC 20541 09:32:53.695627 tst iperf3.py: using RAC 141 09:32:53.816791 tst iperf3.py: using CellId 20541 09:32:53.936494 tst iperf3.py: using BVCI 20542 09:32:54.048215 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.059114 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.069847 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.080409 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.090987 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.101523 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.112154 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.122726 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:32:54.133405 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:32:54.254163 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:32:54.475772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:54.803929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20691): Launched 09:32:55.087559 run iperf3-srv_10.42.42.10(pid=20692): Launched 09:32:55.209535 tst iperf3.py:8: start network... 09:32:55.429344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:55.935205 run create_hlr_db(pid=20693): Launched 09:32:56.059408 bus /gobi_6: Setting Powered False 09:32:57.123670 run create_hlr_db(pid=20693): Terminated: ok {rc=0} 09:32:57.558236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20695): Launched 09:32:57.862495 run osmo-hlr_10.42.42.2(pid=20696): Launched 09:32:57.979436 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:58.518829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20698): Launched 09:32:58.823689 run osmo-stp_10.42.42.5(pid=20699): Launched 09:32:58.939518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:59.463981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20701): Launched 09:32:59.579859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:59.837226 run patchelf(pid=20702): Launched 09:33:00.005814 run osmo-stp_10.42.42.5(pid=20699): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20699)] 09:33:00.134681 run osmo-stp_10.42.42.5(pid=20699): stdout: | (launched: 2022-12-09_09:32:58.767502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:00.264667 run osmo-stp_10.42.42.5(pid=20699): stderr: | [0;m[38;5;43m20221209093258937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093258937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093258938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093258938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093258939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093258939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093258939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:00.394934 run osmo-stp_10.42.42.5(pid=20699): stdout: | (launched: 2022-12-09_09:32:58.767502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:00.519408 run osmo-stp_10.42.42.5(pid=20699): stderr: | [0;m[38;5;43m20221209093258937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093258937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093258938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093258938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093258939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093258939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093258939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:00.666758 run patchelf(pid=20702): Terminating (SIGINT) 09:33:00.843400 run patchelf(pid=20702): Terminated: ok {rc=0} 09:33:00.980820 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20699): Process ended prematurely: osmo-stp_10.42.42.5(pid=20699) [trial-2357↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20699)] [trial-2357↪gprs:nanobts+band-900↪iperf3.py:8] 09:33:00.992317 tst iperf3.py:8: Test FAILED (7.5 sec) 09:33:01.024635 run osmo-hlr_10.42.42.2(pid=20696): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20696)] 09:33:01.079047 run osmo-hlr_10.42.42.2(pid=20696): stdout: | (launched: 2022-12-09_09:32:57.806426) 09:33:01.136328 run osmo-hlr_10.42.42.2(pid=20696): stderr: | [0;m[1;31m20221209093257982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093257982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093257982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093257982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093257982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093257982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093257994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093258002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093258002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093258002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:01.192127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20691): Terminating (SIGTERM) 09:33:01.237147 run iperf3-srv_10.42.42.10(pid=20692): Terminating (SIGTERM) 09:33:01.285892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20695): Terminating (SIGTERM) 09:33:01.331407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20698): Terminating (SIGTERM) 09:33:01.378515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20701): Terminating (SIGTERM) 09:33:01.425810 --- ParallelTerminationStrategy: PID 20691 died... 09:33:01.446884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20691): Terminated: ok {rc=0} 09:33:01.499118 --- ParallelTerminationStrategy: PID 20692 died... 09:33:01.520011 run iperf3-srv_10.42.42.10(pid=20692): Terminated {rc=256} 09:33:01.570337 --- ParallelTerminationStrategy: PID 20695 died... 09:33:01.591007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20695): Terminated: ok {rc=0} 09:33:01.641319 --- ParallelTerminationStrategy: PID 20698 died... 09:33:01.663457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20698): Terminated: ok {rc=0} 09:33:01.713770 --- ParallelTerminationStrategy: PID 20701 died... 09:33:01.734539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20701): Terminated: ok {rc=0} 09:33:01.827291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 09:33:02.971385 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:02.982695 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:33:03.031213 tst iperf3m4.py: using LAC 20542 09:33:03.155186 tst iperf3m4.py: using RAC 142 09:33:03.273395 tst iperf3m4.py: using CellId 20542 09:33:03.392464 tst iperf3m4.py: using BVCI 20543 09:33:03.502232 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.513189 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.523843 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.534553 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.545139 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.555681 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.566558 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.577064 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:03.587808 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:33:03.709696 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:33:03.835607 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:33:03.955531 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:33:04.074082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:33:04.278953 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:04.585669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20704): Launched 09:33:04.850593 run iperf3-srv_10.42.42.10(pid=20705): Launched 09:33:04.964009 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:33:05.167206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:05.472239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20706): Launched 09:33:05.737462 run iperf3-srv_10.42.42.10(pid=20707): Launched 09:33:05.850555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:33:06.053741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:06.372710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20708): Launched 09:33:06.637787 run iperf3-srv_10.42.42.10(pid=20709): Launched 09:33:06.750632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:33:06.952889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:07.261676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20710): Launched 09:33:07.547224 run iperf3-srv_10.42.42.10(pid=20711): Launched 09:33:07.669839 tst iperf3m4.py:8: start network... 09:33:07.889140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:08.397643 run create_hlr_db(pid=20712): Launched 09:33:08.522359 bus /gobi_6: Setting Powered False 09:33:09.587184 run create_hlr_db(pid=20712): Terminated: ok {rc=0} 09:33:10.021710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Launched 09:33:10.328334 run osmo-hlr_10.42.42.2(pid=20715): Launched 09:33:10.446122 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:10.987677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Launched 09:33:11.293958 run osmo-stp_10.42.42.5(pid=20718): Launched 09:33:11.410849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:11.936239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20720): Launched 09:33:12.053245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:12.311657 run patchelf(pid=20721): Launched 09:33:12.480786 run osmo-stp_10.42.42.5(pid=20718): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20718)] 09:33:12.609430 run osmo-stp_10.42.42.5(pid=20718): stdout: | (launched: 2022-12-09_09:33:11.237120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:12.739705 run osmo-stp_10.42.42.5(pid=20718): stderr: | [0;m[38;5;43m20221209093311404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093311404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093311404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093311405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093311405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093311406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093311406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:12.870563 run osmo-stp_10.42.42.5(pid=20718): stdout: | (launched: 2022-12-09_09:33:11.237120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:12.994991 run osmo-stp_10.42.42.5(pid=20718): stderr: | [0;m[38;5;43m20221209093311404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093311404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093311404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093311405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093311405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093311406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093311406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:13.142831 run patchelf(pid=20721): Terminating (SIGINT) 09:33:13.313755 run patchelf(pid=20721): Terminated: ok {rc=0} 09:33:13.436779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20718): Process ended prematurely: osmo-stp_10.42.42.5(pid=20718) [trial-2357↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20718)] [trial-2357↪gprs:nanobts+band-900↪iperf3m4.py:8] 09:33:13.446366 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:33:13.473927 run osmo-hlr_10.42.42.2(pid=20715): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20715)] 09:33:13.521891 run osmo-hlr_10.42.42.2(pid=20715): stdout: | (launched: 2022-12-09_09:33:10.271689) 09:33:13.571248 run osmo-hlr_10.42.42.2(pid=20715): stderr: | [0;m[1;31m20221209093310448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093310448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093310448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093310449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093310449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093310449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093310462 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093310471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093310471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093310471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:13.621150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20704): Terminating (SIGTERM) 09:33:13.661202 run iperf3-srv_10.42.42.10(pid=20705): Terminating (SIGTERM) 09:33:13.701095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20706): Terminating (SIGTERM) 09:33:13.741228 run iperf3-srv_10.42.42.10(pid=20707): Terminating (SIGTERM) 09:33:13.781232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20708): Terminating (SIGTERM) 09:33:13.821658 run iperf3-srv_10.42.42.10(pid=20709): Terminating (SIGTERM) 09:33:13.861388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20710): Terminating (SIGTERM) 09:33:13.901229 run iperf3-srv_10.42.42.10(pid=20711): Terminating (SIGTERM) 09:33:13.941043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Terminating (SIGTERM) 09:33:13.980887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Terminating (SIGTERM) 09:33:14.020773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20720): Terminating (SIGTERM) 09:33:14.062216 --- ParallelTerminationStrategy: PID 20704 died... 09:33:14.081582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20704): Terminated: ok {rc=0} 09:33:14.126007 --- ParallelTerminationStrategy: PID 20705 died... 09:33:14.144445 run iperf3-srv_10.42.42.10(pid=20705): Terminated {rc=256} 09:33:14.188339 --- ParallelTerminationStrategy: PID 20706 died... 09:33:14.207191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20706): Terminated: ok {rc=0} 09:33:14.251042 --- ParallelTerminationStrategy: PID 20707 died... 09:33:14.269867 run iperf3-srv_10.42.42.10(pid=20707): Terminated {rc=256} 09:33:14.313994 --- ParallelTerminationStrategy: PID 20708 died... 09:33:14.332606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20708): Terminated: ok {rc=0} 09:33:14.377329 --- ParallelTerminationStrategy: PID 20709 died... 09:33:14.396085 run iperf3-srv_10.42.42.10(pid=20709): Terminated {rc=256} 09:33:14.440216 --- ParallelTerminationStrategy: PID 20710 died... 09:33:14.458922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20710): Terminated: ok {rc=0} 09:33:14.502622 --- ParallelTerminationStrategy: PID 20711 died... 09:33:14.521255 run iperf3-srv_10.42.42.10(pid=20711): Terminated {rc=256} 09:33:14.564677 --- ParallelTerminationStrategy: PID 20714 died... 09:33:14.583457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20714): Terminated: ok {rc=0} 09:33:14.627989 --- ParallelTerminationStrategy: PID 20717 died... 09:33:14.646693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20717): Terminated: ok {rc=0} 09:33:14.690725 --- ParallelTerminationStrategy: PID 20720 died... 09:33:14.709648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20720): Terminated: ok {rc=0} 09:33:14.794031 bus /gobi_4: Setting Powered False 09:33:15.904523 bus /gobi_4: Setting Powered False 09:33:17.024533 bus /gobi_1: Setting Powered False 09:33:18.121416 bus /gobi_1: Setting Powered False 09:33:19.235904 bus /gobi_0: Setting Powered False 09:33:20.334074 bus /gobi_0: Setting Powered False 09:33:21.449739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900 ping.py ---------------------------------------------- 09:33:22.552703 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:22.564025 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:33:22.614184 tst ping.py: using LAC 20543 09:33:22.731242 tst ping.py: using RAC 143 09:33:22.846564 tst ping.py: using CellId 20543 09:33:22.963283 tst ping.py: using BVCI 20544 09:33:23.071500 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:23.082444 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:23.093157 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:23.103818 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:23.114448 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:23.124921 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:23.135748 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:23.146422 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:33:23.266303 tst ping.py:19: start network... 09:33:23.483116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:23.979498 run create_hlr_db(pid=20722): Launched 09:33:24.102560 bus /gobi_6: Setting Powered False 09:33:25.165640 run create_hlr_db(pid=20722): Terminated: ok {rc=0} 09:33:25.594230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20724): Launched 09:33:25.893688 run osmo-hlr_10.42.42.2(pid=20725): Launched 09:33:26.007739 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:26.539525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20727): Launched 09:33:26.836506 run osmo-stp_10.42.42.5(pid=20728): Launched 09:33:26.949871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:27.463691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20730): Launched 09:33:27.577082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:27.829030 run patchelf(pid=20731): Launched 09:33:27.994195 run osmo-stp_10.42.42.5(pid=20728): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20728)] 09:33:28.120303 run osmo-stp_10.42.42.5(pid=20728): stdout: | (launched: 2022-12-09_09:33:26.781153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:28.248517 run osmo-stp_10.42.42.5(pid=20728): stderr: | [0;m[38;5;43m20221209093326954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093326954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093326954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093326954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093326955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093326955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093326955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:28.376149 run osmo-stp_10.42.42.5(pid=20728): stdout: | (launched: 2022-12-09_09:33:26.781153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:28.498061 run osmo-stp_10.42.42.5(pid=20728): stderr: | [0;m[38;5;43m20221209093326954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093326954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093326954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093326954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093326955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093326955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093326955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:28.642795 run patchelf(pid=20731): Terminating (SIGINT) 09:33:28.809601 run patchelf(pid=20731): Terminated: ok {rc=0} 09:33:28.929372 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20728): Process ended prematurely: osmo-stp_10.42.42.5(pid=20728) [trial-2357↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20728)] [trial-2357↪gprs:nanobts+band-900↪ping.py:22] 09:33:28.938197 tst ping.py:22: Test FAILED (6.4 sec) 09:33:28.965132 run osmo-hlr_10.42.42.2(pid=20725): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20725)] 09:33:29.012788 run osmo-hlr_10.42.42.2(pid=20725): stdout: | (launched: 2022-12-09_09:33:25.837777) 09:33:29.061970 run osmo-hlr_10.42.42.2(pid=20725): stderr: | [0;m[1;31m20221209093326012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093326012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093326012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093326012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093326012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093326012 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093326026 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093326037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093326037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093326037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:29.111704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20724): Terminating (SIGTERM) 09:33:29.151506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20727): Terminating (SIGTERM) 09:33:29.191222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20730): Terminating (SIGTERM) 09:33:29.231324 --- ParallelTerminationStrategy: PID 20724 died... 09:33:29.250672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20724): Terminated: ok {rc=0} 09:33:29.294612 --- ParallelTerminationStrategy: PID 20727 died... 09:33:29.313406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20727): Terminated: ok {rc=0} 09:33:29.357301 --- ParallelTerminationStrategy: PID 20730 died... 09:33:29.375883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20730): Terminated: ok {rc=0} 09:33:29.461617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 09:33:30.549629 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:30.561499 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:33:30.610123 tst ping_idle_ping.py: using LAC 20544 09:33:30.728715 tst ping_idle_ping.py: using RAC 144 09:33:30.881282 tst ping_idle_ping.py: using CellId 20544 09:33:31.020712 tst ping_idle_ping.py: using BVCI 20545 09:33:31.144160 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:31.160644 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:31.174472 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:31.189771 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:31.203799 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:31.215979 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:31.229538 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:33:31.243876 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:33:31.392471 tst ping_idle_ping.py:24: start network... 09:33:31.626882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:32.177134 run create_hlr_db(pid=20732): Launched 09:33:32.337492 bus /gobi_6: Setting Powered False 09:33:33.401636 run create_hlr_db(pid=20732): Terminated: ok {rc=0} 09:33:33.830622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Launched 09:33:34.130579 run osmo-hlr_10.42.42.2(pid=20735): Launched 09:33:34.245633 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:34.774968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Launched 09:33:35.075196 run osmo-stp_10.42.42.5(pid=20738): Launched 09:33:35.189286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:35.704475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20740): Launched 09:33:35.818124 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:36.070254 run patchelf(pid=20741): Launched 09:33:36.237107 run osmo-stp_10.42.42.5(pid=20738): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] 09:33:36.363601 run osmo-stp_10.42.42.5(pid=20738): stdout: | (launched: 2022-12-09_09:33:35.018989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:36.491561 run osmo-stp_10.42.42.5(pid=20738): stderr: | [0;m[38;5;43m20221209093335188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093335188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093335188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093335189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093335189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093335189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093335190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:36.619707 run osmo-stp_10.42.42.5(pid=20738): stdout: | (launched: 2022-12-09_09:33:35.018989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:36.741809 run osmo-stp_10.42.42.5(pid=20738): stderr: | [0;m[38;5;43m20221209093335188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093335188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093335188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093335189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093335189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093335189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093335190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:36.886754 run patchelf(pid=20741): Terminating (SIGINT) 09:33:37.055313 run patchelf(pid=20741): Terminated: ok {rc=0} 09:33:37.176043 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20738): Process ended prematurely: osmo-stp_10.42.42.5(pid=20738) [trial-2357↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] [trial-2357↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 09:33:37.184827 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:33:37.211690 run osmo-hlr_10.42.42.2(pid=20735): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20735)] 09:33:37.258799 run osmo-hlr_10.42.42.2(pid=20735): stdout: | (launched: 2022-12-09_09:33:34.074724) 09:33:37.307641 run osmo-hlr_10.42.42.2(pid=20735): stderr: | [0;m[1;31m20221209093334251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093334251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093334251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093334251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093334251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093334251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093334263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093334274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093334275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093334275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:37.356861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Terminating (SIGTERM) 09:33:37.396604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Terminating (SIGTERM) 09:33:37.436359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20740): Terminating (SIGTERM) 09:33:37.476620 --- ParallelTerminationStrategy: PID 20734 died... 09:33:37.495587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Terminated: ok {rc=0} 09:33:37.540049 --- ParallelTerminationStrategy: PID 20737 died... 09:33:37.558860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Terminated: ok {rc=0} 09:33:37.602697 --- ParallelTerminationStrategy: PID 20740 died... 09:33:37.621475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20740): Terminated: ok {rc=0} 09:33:37.707113 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 09:33:39.010555 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:39.016462 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:33:39.049026 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:33:39.087906 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:33:39.175537 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:33:39.207797 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:33:39.246270 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:33:39.849942 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:33:39.898538 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:39.909580 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:33:39.957904 tst cs_paging_gprs_active.py: using LAC 20545 09:33:40.079199 tst cs_paging_gprs_active.py: using RAC 145 09:33:40.200805 tst cs_paging_gprs_active.py: using CellId 20545 09:33:40.330959 tst cs_paging_gprs_active.py: using BVCI 20546 09:33:40.450367 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.462329 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.473897 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.485819 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.497650 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.509497 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.521457 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.533611 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:40.545671 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:33:40.665927 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:33:40.789846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:33:40.994773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:41.301379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20745): Launched 09:33:41.566362 run iperf3-srv_10.42.42.10(pid=20746): Launched 09:33:41.680234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:33:41.883997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:42.190049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20747): Launched 09:33:42.455842 run iperf3-srv_10.42.42.10(pid=20749): Launched 09:33:42.569590 tst cs_paging_gprs_active.py:38: start network... 09:33:42.773384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:43.245709 run create_hlr_db(pid=20750): Launched 09:33:43.372522 bus /gobi_6: Setting Powered False 09:33:44.437147 run create_hlr_db(pid=20750): Terminated: ok {rc=0} 09:33:44.871897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20752): Launched 09:33:45.177459 run osmo-hlr_10.42.42.2(pid=20753): Launched 09:33:45.293519 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:45.822025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20755): Launched 09:33:46.195421 run osmo-stp_10.42.42.5(pid=20756): Launched 09:33:46.350097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:47.114795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20758): Launched 09:33:47.242778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:47.503684 run patchelf(pid=20759): Launched 09:33:47.672733 run osmo-stp_10.42.42.5(pid=20756): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20756)] 09:33:47.801166 run osmo-stp_10.42.42.5(pid=20756): stdout: | (launched: 2022-12-09_09:33:46.134846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:47.931043 run osmo-stp_10.42.42.5(pid=20756): stderr: | [0;m[38;5;43m20221209093346451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093346451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093346451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093346452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093346452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093346452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093346452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:48.060910 run osmo-stp_10.42.42.5(pid=20756): stdout: | (launched: 2022-12-09_09:33:46.134846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:48.185183 run osmo-stp_10.42.42.5(pid=20756): stderr: | [0;m[38;5;43m20221209093346451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093346451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093346451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093346452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093346452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093346452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093346452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:48.333401 run patchelf(pid=20759): Terminating (SIGINT) 09:33:48.503562 run patchelf(pid=20759): Terminated: ok {rc=0} 09:33:48.625473 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20756): Process ended prematurely: osmo-stp_10.42.42.5(pid=20756) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20756)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:33:48.634837 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:33:48.661893 run osmo-hlr_10.42.42.2(pid=20753): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20753)] 09:33:48.708686 run osmo-hlr_10.42.42.2(pid=20753): stdout: | (launched: 2022-12-09_09:33:45.120508) 09:33:48.757160 run osmo-hlr_10.42.42.2(pid=20753): stderr: | [0;m[1;31m20221209093345298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093345298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093345298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093345298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093345298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093345298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093345310 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093345319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093345319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093345319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:48.805903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20745): Terminating (SIGTERM) 09:33:48.845098 run iperf3-srv_10.42.42.10(pid=20746): Terminating (SIGTERM) 09:33:48.883956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20747): Terminating (SIGTERM) 09:33:48.922986 run iperf3-srv_10.42.42.10(pid=20749): Terminating (SIGTERM) 09:33:48.961839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20752): Terminating (SIGTERM) 09:33:49.000776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20755): Terminating (SIGTERM) 09:33:49.039728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20758): Terminating (SIGTERM) 09:33:49.079085 --- ParallelTerminationStrategy: PID 20745 died... 09:33:49.098001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20745): Terminated: ok {rc=0} 09:33:49.141762 --- ParallelTerminationStrategy: PID 20746 died... 09:33:49.159935 run iperf3-srv_10.42.42.10(pid=20746): Terminated {rc=256} 09:33:49.203235 --- ParallelTerminationStrategy: PID 20747 died... 09:33:49.221740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20747): Terminated: ok {rc=0} 09:33:49.264874 --- ParallelTerminationStrategy: PID 20749 died... 09:33:49.283617 run iperf3-srv_10.42.42.10(pid=20749): Terminated {rc=256} 09:33:49.326930 --- ParallelTerminationStrategy: PID 20752 died... 09:33:49.345415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20752): Terminated: ok {rc=0} 09:33:49.388615 --- ParallelTerminationStrategy: PID 20755 died... 09:33:49.407131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20755): Terminated: ok {rc=0} 09:33:49.450484 --- ParallelTerminationStrategy: PID 20758 died... 09:33:49.468928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20758): Terminated: ok {rc=0} 09:33:49.552239 bus /gobi_0: Setting Powered False 09:33:50.649908 bus /gobi_0: Setting Powered False 09:33:51.769501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:33:52.915295 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:52.926834 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:33:52.981221 tst iperf3.py: using LAC 20546 09:33:53.099266 tst iperf3.py: using RAC 146 09:33:53.228431 tst iperf3.py: using CellId 20546 09:33:53.354487 tst iperf3.py: using BVCI 20547 09:33:53.466541 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.477688 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.488530 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.499531 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.510335 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.521155 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.532139 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.542929 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:33:53.553990 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:33:53.673285 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:33:53.894239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:54.222600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20760): Launched 09:33:54.508591 run iperf3-srv_10.42.42.10(pid=20761): Launched 09:33:54.631651 tst iperf3.py:8: start network... 09:33:54.853175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:55.362423 run create_hlr_db(pid=20762): Launched 09:33:55.487430 bus /gobi_6: Setting Powered False 09:33:56.551543 run create_hlr_db(pid=20762): Terminated: ok {rc=0} 09:33:56.985253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20764): Launched 09:33:57.290239 run osmo-hlr_10.42.42.2(pid=20765): Launched 09:33:57.408141 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:57.933958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20767): Launched 09:33:58.237784 run osmo-stp_10.42.42.5(pid=20768): Launched 09:33:58.353309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:58.878618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20770): Launched 09:33:58.994452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:59.251744 run patchelf(pid=20771): Launched 09:33:59.420161 run osmo-stp_10.42.42.5(pid=20768): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20768)] 09:33:59.548281 run osmo-stp_10.42.42.5(pid=20768): stdout: | (launched: 2022-12-09_09:33:58.181122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:59.678138 run osmo-stp_10.42.42.5(pid=20768): stderr: | [0;m[38;5;43m20221209093358352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093358352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093358353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093358353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093358354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093358354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093358354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:59.808507 run osmo-stp_10.42.42.5(pid=20768): stdout: | (launched: 2022-12-09_09:33:58.181122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:59.932839 run osmo-stp_10.42.42.5(pid=20768): stderr: | [0;m[38;5;43m20221209093358352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093358352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093358353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093358353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093358354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093358354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093358354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:00.079944 run patchelf(pid=20771): Terminating (SIGINT) 09:34:00.250202 run patchelf(pid=20771): Terminated: ok {rc=0} 09:34:00.372911 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20768): Process ended prematurely: osmo-stp_10.42.42.5(pid=20768) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20768)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 09:34:00.382477 tst iperf3.py:8: Test FAILED (7.5 sec) 09:34:00.409944 run osmo-hlr_10.42.42.2(pid=20765): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20765)] 09:34:00.457283 run osmo-hlr_10.42.42.2(pid=20765): stdout: | (launched: 2022-12-09_09:33:57.233884) 09:34:00.506118 run osmo-hlr_10.42.42.2(pid=20765): stderr: | [0;m[1;31m20221209093357410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093357410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093357410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093357410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093357410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093357410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093357422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093357430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093357431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093357431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:00.555311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20760): Terminating (SIGTERM) 09:34:00.594754 run iperf3-srv_10.42.42.10(pid=20761): Terminating (SIGTERM) 09:34:00.634404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20764): Terminating (SIGTERM) 09:34:00.673852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20767): Terminating (SIGTERM) 09:34:00.713091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20770): Terminating (SIGTERM) 09:34:00.752857 --- ParallelTerminationStrategy: PID 20760 died... 09:34:00.771916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20760): Terminated: ok {rc=0} 09:34:00.815750 --- ParallelTerminationStrategy: PID 20761 died... 09:34:00.835124 run iperf3-srv_10.42.42.10(pid=20761): Terminated {rc=256} 09:34:00.885064 --- ParallelTerminationStrategy: PID 20764 died... 09:34:00.904716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20764): Terminated: ok {rc=0} 09:34:00.949942 --- ParallelTerminationStrategy: PID 20767 died... 09:34:00.969250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20767): Terminated: ok {rc=0} 09:34:01.014456 --- ParallelTerminationStrategy: PID 20770 died... 09:34:01.033716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20770): Terminated: ok {rc=0} 09:34:01.119081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:34:02.261543 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.274220 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:34:02.324490 tst iperf3m4.py: using LAC 20547 09:34:02.444146 tst iperf3m4.py: using RAC 147 09:34:02.569326 tst iperf3m4.py: using CellId 20547 09:34:02.696585 tst iperf3m4.py: using BVCI 20548 09:34:02.815032 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.826772 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.838462 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.850417 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.862374 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.874394 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.886657 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.898473 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:02.910422 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:34:03.034884 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:34:03.158450 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:34:03.276463 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:34:03.399403 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:34:03.621030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:03.948935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20772): Launched 09:34:04.233197 run iperf3-srv_10.42.42.10(pid=20773): Launched 09:34:04.356219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:34:04.576527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:04.904743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20774): Launched 09:34:05.189092 run iperf3-srv_10.42.42.10(pid=20775): Launched 09:34:05.311664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:34:05.532362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:05.860660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20776): Launched 09:34:06.145217 run iperf3-srv_10.42.42.10(pid=20777): Launched 09:34:06.267591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:34:06.488677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:06.817755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20778): Launched 09:34:07.103253 run iperf3-srv_10.42.42.10(pid=20779): Launched 09:34:07.225775 tst iperf3m4.py:8: start network... 09:34:07.446949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:07.953873 run create_hlr_db(pid=20780): Launched 09:34:08.079661 bus /gobi_6: Setting Powered False 09:34:09.143601 run create_hlr_db(pid=20780): Terminated: ok {rc=0} 09:34:09.577721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20782): Launched 09:34:09.882164 run osmo-hlr_10.42.42.2(pid=20783): Launched 09:34:09.998391 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:10.525839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20785): Launched 09:34:10.831235 run osmo-stp_10.42.42.5(pid=20786): Launched 09:34:10.947667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:11.471873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20788): Launched 09:34:11.587916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:11.846167 run patchelf(pid=20789): Launched 09:34:12.015976 run osmo-stp_10.42.42.5(pid=20786): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20786)] 09:34:12.144405 run osmo-stp_10.42.42.5(pid=20786): stdout: | (launched: 2022-12-09_09:34:10.774414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:12.274766 run osmo-stp_10.42.42.5(pid=20786): stderr: | [0;m[38;5;43m20221209093410943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093410943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093410943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093410944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093410944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093410944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093410944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:12.404738 run osmo-stp_10.42.42.5(pid=20786): stdout: | (launched: 2022-12-09_09:34:10.774414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:12.530384 run osmo-stp_10.42.42.5(pid=20786): stderr: | [0;m[38;5;43m20221209093410943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093410943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093410943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093410944 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093410944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093410944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093410944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:12.678051 run patchelf(pid=20789): Terminating (SIGINT) 09:34:12.848604 run patchelf(pid=20789): Terminated: ok {rc=0} 09:34:12.971201 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20786): Process ended prematurely: osmo-stp_10.42.42.5(pid=20786) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20786)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 09:34:12.980658 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:34:13.008251 run osmo-hlr_10.42.42.2(pid=20783): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20783)] 09:34:13.055761 run osmo-hlr_10.42.42.2(pid=20783): stdout: | (launched: 2022-12-09_09:34:09.825897) 09:34:13.104703 run osmo-hlr_10.42.42.2(pid=20783): stderr: | [0;m[1;31m20221209093410001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093410001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093410001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093410001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093410001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093410001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093410014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093410022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093410023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093410023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:13.154241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20772): Terminating (SIGTERM) 09:34:13.194101 run iperf3-srv_10.42.42.10(pid=20773): Terminating (SIGTERM) 09:34:13.233936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20774): Terminating (SIGTERM) 09:34:13.273708 run iperf3-srv_10.42.42.10(pid=20775): Terminating (SIGTERM) 09:34:13.313308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20776): Terminating (SIGTERM) 09:34:13.353601 run iperf3-srv_10.42.42.10(pid=20777): Terminating (SIGTERM) 09:34:13.393314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20778): Terminating (SIGTERM) 09:34:13.433420 run iperf3-srv_10.42.42.10(pid=20779): Terminating (SIGTERM) 09:34:13.473045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20782): Terminating (SIGTERM) 09:34:13.512648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20785): Terminating (SIGTERM) 09:34:13.552443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20788): Terminating (SIGTERM) 09:34:13.592509 --- ParallelTerminationStrategy: PID 20772 died... 09:34:13.611839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20772): Terminated: ok {rc=0} 09:34:13.655809 --- ParallelTerminationStrategy: PID 20773 died... 09:34:13.674642 run iperf3-srv_10.42.42.10(pid=20773): Terminated {rc=256} 09:34:13.718183 --- ParallelTerminationStrategy: PID 20774 died... 09:34:13.736515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20774): Terminated: ok {rc=0} 09:34:13.780025 --- ParallelTerminationStrategy: PID 20775 died... 09:34:13.798592 run iperf3-srv_10.42.42.10(pid=20775): Terminated {rc=256} 09:34:13.841736 --- ParallelTerminationStrategy: PID 20776 died... 09:34:13.860005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20776): Terminated: ok {rc=0} 09:34:13.903710 --- ParallelTerminationStrategy: PID 20777 died... 09:34:13.922449 run iperf3-srv_10.42.42.10(pid=20777): Terminated {rc=256} 09:34:13.966053 --- ParallelTerminationStrategy: PID 20778 died... 09:34:13.984758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20778): Terminated: ok {rc=0} 09:34:14.028395 --- ParallelTerminationStrategy: PID 20779 died... 09:34:14.047171 run iperf3-srv_10.42.42.10(pid=20779): Terminated {rc=256} 09:34:14.090983 --- ParallelTerminationStrategy: PID 20782 died... 09:34:14.109706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20782): Terminated: ok {rc=0} 09:34:14.153539 --- ParallelTerminationStrategy: PID 20785 died... 09:34:14.172388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20785): Terminated: ok {rc=0} 09:34:14.216161 --- ParallelTerminationStrategy: PID 20788 died... 09:34:14.235102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20788): Terminated: ok {rc=0} 09:34:14.320915 bus /gobi_4: Setting Powered False 09:34:15.420777 bus /gobi_4: Setting Powered False 09:34:16.544780 bus /gobi_1: Setting Powered False 09:34:17.649740 bus /gobi_1: Setting Powered False 09:34:18.764327 bus /gobi_0: Setting Powered False 09:34:19.863687 bus /gobi_0: Setting Powered False 09:34:20.979229 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 09:34:22.083995 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.095848 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:34:22.145690 tst ping.py: using LAC 20548 09:34:22.265111 tst ping.py: using RAC 148 09:34:22.382981 tst ping.py: using CellId 20548 09:34:22.500479 tst ping.py: using BVCI 20549 09:34:22.609460 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.620598 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.631578 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.642514 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.653275 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.663982 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.674935 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:22.685817 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:34:22.804766 tst ping.py:19: start network... 09:34:23.019682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:23.516215 run create_hlr_db(pid=20790): Launched 09:34:23.640279 bus /gobi_6: Setting Powered False 09:34:24.704145 run create_hlr_db(pid=20790): Terminated: ok {rc=0} 09:34:25.133653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20792): Launched 09:34:25.434186 run osmo-hlr_10.42.42.2(pid=20793): Launched 09:34:25.548229 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:26.066502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20795): Launched 09:34:26.365543 run osmo-stp_10.42.42.5(pid=20796): Launched 09:34:26.480037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:26.998509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20798): Launched 09:34:27.113263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:27.367961 run patchelf(pid=20799): Launched 09:34:27.534554 run osmo-stp_10.42.42.5(pid=20796): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20796)] 09:34:27.660835 run osmo-stp_10.42.42.5(pid=20796): stdout: | (launched: 2022-12-09_09:34:26.309587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:27.788533 run osmo-stp_10.42.42.5(pid=20796): stderr: | [0;m[38;5;43m20221209093426482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093426482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093426482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093426483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093426483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093426483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093426483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:27.916584 run osmo-stp_10.42.42.5(pid=20796): stdout: | (launched: 2022-12-09_09:34:26.309587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:28.039106 run osmo-stp_10.42.42.5(pid=20796): stderr: | [0;m[38;5;43m20221209093426482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093426482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093426482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093426483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093426483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093426483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093426483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:28.184557 run patchelf(pid=20799): Terminating (SIGINT) 09:34:28.351961 run patchelf(pid=20799): Terminated: ok {rc=0} 09:34:28.472240 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20796): Process ended prematurely: osmo-stp_10.42.42.5(pid=20796) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20796)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 09:34:28.481320 tst ping.py:22: Test FAILED (6.4 sec) 09:34:28.508101 run osmo-hlr_10.42.42.2(pid=20793): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20793)] 09:34:28.555186 run osmo-hlr_10.42.42.2(pid=20793): stdout: | (launched: 2022-12-09_09:34:25.378174) 09:34:28.603831 run osmo-hlr_10.42.42.2(pid=20793): stderr: | [0;m[1;31m20221209093425553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093425553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093425554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093425554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093425554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093425554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093425566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093425574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093425575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093425575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:28.653395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20792): Terminating (SIGTERM) 09:34:28.692837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20795): Terminating (SIGTERM) 09:34:28.732213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20798): Terminating (SIGTERM) 09:34:28.771983 --- ParallelTerminationStrategy: PID 20792 died... 09:34:28.791121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20792): Terminated: ok {rc=0} 09:34:28.834942 --- ParallelTerminationStrategy: PID 20795 died... 09:34:28.853663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20795): Terminated: ok {rc=0} 09:34:28.897665 --- ParallelTerminationStrategy: PID 20798 died... 09:34:28.916400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20798): Terminated: ok {rc=0} 09:34:28.999972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:34:30.086381 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.098786 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:34:30.152900 tst ping_idle_ping.py: using LAC 20549 09:34:30.280338 tst ping_idle_ping.py: using RAC 149 09:34:30.408617 tst ping_idle_ping.py: using CellId 20549 09:34:30.535991 tst ping_idle_ping.py: using BVCI 20550 09:34:30.652865 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.664771 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.676382 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.688493 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.701828 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.713945 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.725874 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:34:30.737968 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:34:30.874390 tst ping_idle_ping.py:24: start network... 09:34:31.116901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:31.699376 run create_hlr_db(pid=20800): Launched 09:34:31.856715 bus /gobi_6: Setting Powered False 09:34:32.916842 run create_hlr_db(pid=20800): Terminated: ok {rc=0} 09:34:33.348810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20802): Launched 09:34:33.649467 run osmo-hlr_10.42.42.2(pid=20803): Launched 09:34:33.763375 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:34.277657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20805): Launched 09:34:34.576265 run osmo-stp_10.42.42.5(pid=20806): Launched 09:34:34.690731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:35.206913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20808): Launched 09:34:35.321084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:35.574009 run patchelf(pid=20809): Launched 09:34:35.740440 run osmo-stp_10.42.42.5(pid=20806): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20806)] 09:34:35.867103 run osmo-stp_10.42.42.5(pid=20806): stdout: | (launched: 2022-12-09_09:34:34.520576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:35.995532 run osmo-stp_10.42.42.5(pid=20806): stderr: | [0;m[38;5;43m20221209093434692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093434692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093434693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093434693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093434693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093434693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093434694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:36.123657 run osmo-stp_10.42.42.5(pid=20806): stdout: | (launched: 2022-12-09_09:34:34.520576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:36.246562 run osmo-stp_10.42.42.5(pid=20806): stderr: | [0;m[38;5;43m20221209093434692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093434692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093434693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093434693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093434693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093434693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093434694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:36.391883 run patchelf(pid=20809): Terminating (SIGINT) 09:34:36.559779 run patchelf(pid=20809): Terminated: ok {rc=0} 09:34:36.681159 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20806): Process ended prematurely: osmo-stp_10.42.42.5(pid=20806) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20806)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:34:36.690648 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:34:36.718003 run osmo-hlr_10.42.42.2(pid=20803): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20803)] 09:34:36.765303 run osmo-hlr_10.42.42.2(pid=20803): stdout: | (launched: 2022-12-09_09:34:33.593435) 09:34:36.814350 run osmo-hlr_10.42.42.2(pid=20803): stderr: | [0;m[1;31m20221209093433769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093433770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093433770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093433770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093433770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093433770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093433782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093433792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093433793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093433793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:36.863539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20802): Terminating (SIGTERM) 09:34:36.902956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20805): Terminating (SIGTERM) 09:34:36.942625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20808): Terminating (SIGTERM) 09:34:36.982514 --- ParallelTerminationStrategy: PID 20802 died... 09:34:37.001476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20802): Terminated: ok {rc=0} 09:34:37.045490 --- ParallelTerminationStrategy: PID 20805 died... 09:34:37.064354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20805): Terminated: ok {rc=0} 09:34:37.107860 --- ParallelTerminationStrategy: PID 20808 died... 09:34:37.126452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20808): Terminated: ok {rc=0} 09:34:37.209618 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:34:38.523508 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:38.531011 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:34:38.566312 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:34:38.606828 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:34:38.699743 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:34:38.734741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:34:38.774451 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:34:39.371503 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:34:39.425566 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:39.437355 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:34:39.507332 tst cs_paging_gprs_active.py: using LAC 20550 09:34:39.637642 tst cs_paging_gprs_active.py: using RAC 150 09:34:39.761082 tst cs_paging_gprs_active.py: using CellId 20550 09:34:39.882093 tst cs_paging_gprs_active.py: using BVCI 20551 09:34:39.995246 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.006602 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.017871 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.029627 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.041237 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.052784 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.064461 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.075987 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:40.087735 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:34:40.211039 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:34:40.329693 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:34:40.536470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:40.845915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20813): Launched 09:34:41.112814 run iperf3-srv_10.42.42.10(pid=20814): Launched 09:34:41.227787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:34:41.433290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:41.741321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20815): Launched 09:34:42.007605 run iperf3-srv_10.42.42.10(pid=20816): Launched 09:34:42.121875 tst cs_paging_gprs_active.py:38: start network... 09:34:42.326441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:42.800511 run create_hlr_db(pid=20817): Launched 09:34:42.925577 bus /gobi_6: Setting Powered False 09:34:43.986209 run create_hlr_db(pid=20817): Terminated: ok {rc=0} 09:34:44.410063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20819): Launched 09:34:44.715040 run osmo-hlr_10.42.42.2(pid=20820): Launched 09:34:44.831564 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:45.361345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20822): Launched 09:34:45.666866 run osmo-stp_10.42.42.5(pid=20823): Launched 09:34:45.782687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:46.421014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20825): Launched 09:34:46.558946 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:46.847681 run patchelf(pid=20826): Launched 09:34:47.078048 run osmo-stp_10.42.42.5(pid=20823): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20823)] 09:34:47.210076 run osmo-stp_10.42.42.5(pid=20823): stdout: | (launched: 2022-12-09_09:34:45.609719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:47.340231 run osmo-stp_10.42.42.5(pid=20823): stderr: | [0;m[38;5;43m20221209093445780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093445780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093445780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093445780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093445781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093445781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093445781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:47.470522 run osmo-stp_10.42.42.5(pid=20823): stdout: | (launched: 2022-12-09_09:34:45.609719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:47.595186 run osmo-stp_10.42.42.5(pid=20823): stderr: | [0;m[38;5;43m20221209093445780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093445780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093445780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093445780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093445781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093445781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093445781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:47.742764 run patchelf(pid=20826): Terminating (SIGINT) 09:34:47.913143 run patchelf(pid=20826): Terminated: ok {rc=0} 09:34:48.036028 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20823): Process ended prematurely: osmo-stp_10.42.42.5(pid=20823) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20823)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:34:48.045839 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:34:48.072836 run osmo-hlr_10.42.42.2(pid=20820): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20820)] 09:34:48.120480 run osmo-hlr_10.42.42.2(pid=20820): stdout: | (launched: 2022-12-09_09:34:44.658552) 09:34:48.169581 run osmo-hlr_10.42.42.2(pid=20820): stderr: | [0;m[1;31m20221209093444835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093444835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093444835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093444835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093444835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093444835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093444848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093444857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093444857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093444857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:48.218969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20813): Terminating (SIGTERM) 09:34:48.258804 run iperf3-srv_10.42.42.10(pid=20814): Terminating (SIGTERM) 09:34:48.298495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20815): Terminating (SIGTERM) 09:34:48.338166 run iperf3-srv_10.42.42.10(pid=20816): Terminating (SIGTERM) 09:34:48.377642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20819): Terminating (SIGTERM) 09:34:48.417212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20822): Terminating (SIGTERM) 09:34:48.456930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20825): Terminating (SIGTERM) 09:34:48.497048 --- ParallelTerminationStrategy: PID 20813 died... 09:34:48.516226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20813): Terminated: ok {rc=0} 09:34:48.560099 --- ParallelTerminationStrategy: PID 20814 died... 09:34:48.578784 run iperf3-srv_10.42.42.10(pid=20814): Terminated {rc=256} 09:34:48.622383 --- ParallelTerminationStrategy: PID 20815 died... 09:34:48.641042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20815): Terminated: ok {rc=0} 09:34:48.684536 --- ParallelTerminationStrategy: PID 20816 died... 09:34:48.703303 run iperf3-srv_10.42.42.10(pid=20816): Terminated {rc=256} 09:34:48.747473 --- ParallelTerminationStrategy: PID 20819 died... 09:34:48.766188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20819): Terminated: ok {rc=0} 09:34:48.810670 --- ParallelTerminationStrategy: PID 20822 died... 09:34:48.829518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20822): Terminated: ok {rc=0} 09:34:48.873326 --- ParallelTerminationStrategy: PID 20825 died... 09:34:48.891801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20825): Terminated: ok {rc=0} 09:34:48.977309 bus /gobi_0: Setting Powered False 09:34:50.076572 bus /gobi_0: Setting Powered False 09:34:51.191960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:34:52.337984 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.349842 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:34:52.420253 tst iperf3.py: using LAC 20551 09:34:52.541359 tst iperf3.py: using RAC 151 09:34:52.662440 tst iperf3.py: using CellId 20551 09:34:52.782961 tst iperf3.py: using BVCI 20552 09:34:52.895344 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.906960 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.918150 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.929227 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.940147 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.951286 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.962448 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.973422 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:34:52.984535 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:34:53.101634 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:34:53.306236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:34:53.613659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20827): Launched 09:34:53.879946 run iperf3-srv_10.42.42.10(pid=20828): Launched 09:34:53.994168 tst iperf3.py:8: start network... 09:34:54.198075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:54.672363 run create_hlr_db(pid=20829): Launched 09:34:54.798809 bus /gobi_6: Setting Powered False 09:34:55.862686 run create_hlr_db(pid=20829): Terminated: ok {rc=0} 09:34:56.298991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20831): Launched 09:34:56.605953 run osmo-hlr_10.42.42.2(pid=20832): Launched 09:34:56.724552 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:57.251895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20834): Launched 09:34:57.556210 run osmo-stp_10.42.42.5(pid=20835): Launched 09:34:57.672486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:58.197656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20837): Launched 09:34:58.313425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:58.570351 run patchelf(pid=20838): Launched 09:34:58.738518 run osmo-stp_10.42.42.5(pid=20835): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20835)] 09:34:58.867519 run osmo-stp_10.42.42.5(pid=20835): stdout: | (launched: 2022-12-09_09:34:57.499644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:58.998073 run osmo-stp_10.42.42.5(pid=20835): stderr: | [0;m[38;5;43m20221209093457669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093457670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093457670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093457670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093457671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093457671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093457671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:59.128225 run osmo-stp_10.42.42.5(pid=20835): stdout: | (launched: 2022-12-09_09:34:57.499644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:59.252495 run osmo-stp_10.42.42.5(pid=20835): stderr: | [0;m[38;5;43m20221209093457669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093457670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093457670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093457670 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093457671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093457671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093457671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:59.399910 run patchelf(pid=20838): Terminating (SIGINT) 09:34:59.570587 run patchelf(pid=20838): Terminated: ok {rc=0} 09:34:59.693272 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20835): Process ended prematurely: osmo-stp_10.42.42.5(pid=20835) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20835)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:34:59.702719 tst iperf3.py:8: Test FAILED (7.4 sec) 09:34:59.729861 run osmo-hlr_10.42.42.2(pid=20832): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20832)] 09:34:59.777429 run osmo-hlr_10.42.42.2(pid=20832): stdout: | (launched: 2022-12-09_09:34:56.549212) 09:34:59.827213 run osmo-hlr_10.42.42.2(pid=20832): stderr: | [0;m[1;31m20221209093456726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093456726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093456726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093456726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093456726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093456726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093456738 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093456747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093456747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093456747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:59.877660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20827): Terminating (SIGTERM) 09:34:59.917739 run iperf3-srv_10.42.42.10(pid=20828): Terminating (SIGTERM) 09:34:59.957709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20831): Terminating (SIGTERM) 09:34:59.997615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20834): Terminating (SIGTERM) 09:35:00.037413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20837): Terminating (SIGTERM) 09:35:00.077632 --- ParallelTerminationStrategy: PID 20827 died... 09:35:00.096653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20827): Terminated: ok {rc=0} 09:35:00.141017 --- ParallelTerminationStrategy: PID 20828 died... 09:35:00.159834 run iperf3-srv_10.42.42.10(pid=20828): Terminated {rc=256} 09:35:00.203794 --- ParallelTerminationStrategy: PID 20831 died... 09:35:00.222638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20831): Terminated: ok {rc=0} 09:35:00.266610 --- ParallelTerminationStrategy: PID 20834 died... 09:35:00.285640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20834): Terminated: ok {rc=0} 09:35:00.330063 --- ParallelTerminationStrategy: PID 20837 died... 09:35:00.348919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20837): Terminated: ok {rc=0} 09:35:00.434374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:35:01.613982 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:01.630550 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:35:01.721413 tst iperf3m4.py: using LAC 20552 09:35:01.848780 tst iperf3m4.py: using RAC 152 09:35:01.984087 tst iperf3m4.py: using CellId 20552 09:35:02.158985 tst iperf3m4.py: using BVCI 20553 09:35:02.275134 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.286883 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.298441 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.310092 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.321660 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.333236 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.344528 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.355475 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:02.367214 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:35:02.487118 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:35:02.607618 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:35:02.729998 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:35:02.851452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:35:03.073569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:03.403781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20842): Launched 09:35:03.689622 run iperf3-srv_10.42.42.10(pid=20843): Launched 09:35:03.811523 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:35:04.031716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:04.360103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20844): Launched 09:35:04.644903 run iperf3-srv_10.42.42.10(pid=20845): Launched 09:35:04.767578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:35:04.989015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:05.318208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20846): Launched 09:35:05.603581 run iperf3-srv_10.42.42.10(pid=20847): Launched 09:35:05.726056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:35:05.945751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:06.274713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20848): Launched 09:35:06.561026 run iperf3-srv_10.42.42.10(pid=20849): Launched 09:35:06.683894 tst iperf3m4.py:8: start network... 09:35:06.903882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:07.411580 run create_hlr_db(pid=20850): Launched 09:35:07.536745 bus /gobi_6: Setting Powered False 09:35:08.601630 run create_hlr_db(pid=20850): Terminated: ok {rc=0} 09:35:09.056175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Launched 09:35:09.383658 run osmo-hlr_10.42.42.2(pid=20853): Launched 09:35:09.509334 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:10.038976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20855): Launched 09:35:10.345900 run osmo-stp_10.42.42.5(pid=20856): Launched 09:35:10.462720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:10.990459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20858): Launched 09:35:11.106144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:11.364255 run patchelf(pid=20859): Launched 09:35:11.533352 run osmo-stp_10.42.42.5(pid=20856): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20856)] 09:35:11.661810 run osmo-stp_10.42.42.5(pid=20856): stdout: | (launched: 2022-12-09_09:35:10.288570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:11.792065 run osmo-stp_10.42.42.5(pid=20856): stderr: | [0;m[38;5;43m20221209093510458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093510459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093510459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093510459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093510460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093510460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093510460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:11.922503 run osmo-stp_10.42.42.5(pid=20856): stdout: | (launched: 2022-12-09_09:35:10.288570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:12.047154 run osmo-stp_10.42.42.5(pid=20856): stderr: | [0;m[38;5;43m20221209093510458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093510459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093510459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093510459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093510460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093510460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093510460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:12.194979 run patchelf(pid=20859): Terminating (SIGINT) 09:35:12.365932 run patchelf(pid=20859): Terminated: ok {rc=0} 09:35:12.489244 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20856): Process ended prematurely: osmo-stp_10.42.42.5(pid=20856) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20856)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:35:12.498715 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:35:12.526431 run osmo-hlr_10.42.42.2(pid=20853): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20853)] 09:35:12.574285 run osmo-hlr_10.42.42.2(pid=20853): stdout: | (launched: 2022-12-09_09:35:09.322928) 09:35:12.623793 run osmo-hlr_10.42.42.2(pid=20853): stderr: | [0;m[1;31m20221209093509523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093509523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093509523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093509523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093509523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093509523 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093509536 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093509544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093509544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093509545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:12.673713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20842): Terminating (SIGTERM) 09:35:12.714111 run iperf3-srv_10.42.42.10(pid=20843): Terminating (SIGTERM) 09:35:12.754284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20844): Terminating (SIGTERM) 09:35:12.794321 run iperf3-srv_10.42.42.10(pid=20845): Terminating (SIGTERM) 09:35:12.834357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20846): Terminating (SIGTERM) 09:35:12.874544 run iperf3-srv_10.42.42.10(pid=20847): Terminating (SIGTERM) 09:35:12.914651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20848): Terminating (SIGTERM) 09:35:12.954755 run iperf3-srv_10.42.42.10(pid=20849): Terminating (SIGTERM) 09:35:12.995322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Terminating (SIGTERM) 09:35:13.035560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20855): Terminating (SIGTERM) 09:35:13.075470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20858): Terminating (SIGTERM) 09:35:13.115987 --- ParallelTerminationStrategy: PID 20842 died... 09:35:13.135321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20842): Terminated: ok {rc=0} 09:35:13.179945 --- ParallelTerminationStrategy: PID 20843 died... 09:35:13.198865 run iperf3-srv_10.42.42.10(pid=20843): Terminated {rc=256} 09:35:13.242709 --- ParallelTerminationStrategy: PID 20844 died... 09:35:13.261485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20844): Terminated: ok {rc=0} 09:35:13.305785 --- ParallelTerminationStrategy: PID 20845 died... 09:35:13.324626 run iperf3-srv_10.42.42.10(pid=20845): Terminated {rc=256} 09:35:13.368882 --- ParallelTerminationStrategy: PID 20846 died... 09:35:13.387916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20846): Terminated: ok {rc=0} 09:35:13.432033 --- ParallelTerminationStrategy: PID 20847 died... 09:35:13.451034 run iperf3-srv_10.42.42.10(pid=20847): Terminated {rc=256} 09:35:13.495268 --- ParallelTerminationStrategy: PID 20848 died... 09:35:13.514243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20848): Terminated: ok {rc=0} 09:35:13.558524 --- ParallelTerminationStrategy: PID 20849 died... 09:35:13.577412 run iperf3-srv_10.42.42.10(pid=20849): Terminated {rc=256} 09:35:13.621309 --- ParallelTerminationStrategy: PID 20852 died... 09:35:13.639939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Terminated: ok {rc=0} 09:35:13.683802 --- ParallelTerminationStrategy: PID 20855 died... 09:35:13.702545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20855): Terminated: ok {rc=0} 09:35:13.746423 --- ParallelTerminationStrategy: PID 20858 died... 09:35:13.765476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20858): Terminated: ok {rc=0} 09:35:13.851768 bus /gobi_4: Setting Powered False 09:35:14.953082 bus /gobi_4: Setting Powered False 09:35:16.080552 bus /gobi_1: Setting Powered False 09:35:17.184892 bus /gobi_1: Setting Powered False 09:35:18.308849 bus /gobi_0: Setting Powered False 09:35:19.408178 bus /gobi_0: Setting Powered False 09:35:20.524088 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:35:21.629266 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:21.640922 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:35:21.709986 tst ping.py: using LAC 20553 09:35:21.829746 tst ping.py: using RAC 153 09:35:21.949250 tst ping.py: using CellId 20553 09:35:22.066461 tst ping.py: using BVCI 20554 09:35:22.176388 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:22.187636 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:22.198576 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:22.209711 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:22.220622 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:22.231765 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:22.242871 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:22.253880 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:35:22.374476 tst ping.py:19: start network... 09:35:22.590444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:23.087492 run create_hlr_db(pid=20861): Launched 09:35:23.211536 bus /gobi_6: Setting Powered False 09:35:24.274672 run create_hlr_db(pid=20861): Terminated: ok {rc=0} 09:35:24.722466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Launched 09:35:25.044815 run osmo-hlr_10.42.42.2(pid=20864): Launched 09:35:25.168328 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:25.728001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Launched 09:35:26.048776 run osmo-stp_10.42.42.5(pid=20867): Launched 09:35:26.171839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:26.727407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20869): Launched 09:35:26.846403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:27.101312 run patchelf(pid=20870): Launched 09:35:27.268124 run osmo-stp_10.42.42.5(pid=20867): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] 09:35:27.394726 run osmo-stp_10.42.42.5(pid=20867): stdout: | (launched: 2022-12-09_09:35:25.989457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:27.523289 run osmo-stp_10.42.42.5(pid=20867): stderr: | [0;m[38;5;43m20221209093526182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093526182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093526182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093526183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093526183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093526183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093526183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:27.651565 run osmo-stp_10.42.42.5(pid=20867): stdout: | (launched: 2022-12-09_09:35:25.989457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:27.774624 run osmo-stp_10.42.42.5(pid=20867): stderr: | [0;m[38;5;43m20221209093526182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093526182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093526182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093526183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093526183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093526183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093526183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:27.919729 run patchelf(pid=20870): Terminating (SIGINT) 09:35:28.087770 run patchelf(pid=20870): Terminated: ok {rc=0} 09:35:28.208770 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20867): Process ended prematurely: osmo-stp_10.42.42.5(pid=20867) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 09:35:28.217748 tst ping.py:22: Test FAILED (6.6 sec) 09:35:28.244645 run osmo-hlr_10.42.42.2(pid=20864): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20864)] 09:35:28.292150 run osmo-hlr_10.42.42.2(pid=20864): stdout: | (launched: 2022-12-09_09:35:24.985528) 09:35:28.341734 run osmo-hlr_10.42.42.2(pid=20864): stderr: | [0;m[1;31m20221209093525186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093525186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093525186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093525186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093525186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093525186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093525198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093525207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093525207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093525207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:28.391635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Terminating (SIGTERM) 09:35:28.431916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Terminating (SIGTERM) 09:35:28.472096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20869): Terminating (SIGTERM) 09:35:28.512673 --- ParallelTerminationStrategy: PID 20863 died... 09:35:28.531875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20863): Terminated: ok {rc=0} 09:35:28.576567 --- ParallelTerminationStrategy: PID 20866 died... 09:35:28.595662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20866): Terminated: ok {rc=0} 09:35:28.640270 --- ParallelTerminationStrategy: PID 20869 died... 09:35:28.659169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20869): Terminated: ok {rc=0} 09:35:28.745688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:35:29.832708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:29.844778 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:35:29.914297 tst ping_idle_ping.py: using LAC 20554 09:35:30.033242 tst ping_idle_ping.py: using RAC 154 09:35:30.151405 tst ping_idle_ping.py: using CellId 20554 09:35:30.269186 tst ping_idle_ping.py: using BVCI 20555 09:35:30.378093 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:30.389448 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:30.400522 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:30.411656 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:30.422696 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:30.433792 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:30.445139 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:35:30.456409 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:35:30.573577 tst ping_idle_ping.py:24: start network... 09:35:30.775343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:31.262464 run create_hlr_db(pid=20871): Launched 09:35:31.436310 bus /gobi_6: Setting Powered False 09:35:32.500602 run create_hlr_db(pid=20871): Terminated: ok {rc=0} 09:35:32.950688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20873): Launched 09:35:33.251428 run osmo-hlr_10.42.42.2(pid=20874): Launched 09:35:33.365451 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:33.884481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20876): Launched 09:35:34.184900 run osmo-stp_10.42.42.5(pid=20877): Launched 09:35:34.299057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:34.816346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20879): Launched 09:35:34.931601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:35.186951 run patchelf(pid=20880): Launched 09:35:35.353870 run osmo-stp_10.42.42.5(pid=20877): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20877)] 09:35:35.480752 run osmo-stp_10.42.42.5(pid=20877): stdout: | (launched: 2022-12-09_09:35:34.128764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:35.609348 run osmo-stp_10.42.42.5(pid=20877): stderr: | [0;m[38;5;43m20221209093534299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093534299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093534299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093534299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093534300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093534300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093534300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:35.737688 run osmo-stp_10.42.42.5(pid=20877): stdout: | (launched: 2022-12-09_09:35:34.128764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:35.860585 run osmo-stp_10.42.42.5(pid=20877): stderr: | [0;m[38;5;43m20221209093534299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093534299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093534299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093534299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093534300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093534300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093534300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:36.006362 run patchelf(pid=20880): Terminating (SIGINT) 09:35:36.174928 run patchelf(pid=20880): Terminated: ok {rc=0} 09:35:36.296168 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20877): Process ended prematurely: osmo-stp_10.42.42.5(pid=20877) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20877)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:35:36.305524 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:35:36.332698 run osmo-hlr_10.42.42.2(pid=20874): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20874)] 09:35:36.380341 run osmo-hlr_10.42.42.2(pid=20874): stdout: | (launched: 2022-12-09_09:35:33.194945) 09:35:36.429665 run osmo-hlr_10.42.42.2(pid=20874): stderr: | [0;m[1;31m20221209093533373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093533373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093533373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093533373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093533373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093533373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093533385 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093533394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093533394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093533394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:36.479524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20873): Terminating (SIGTERM) 09:35:36.519475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20876): Terminating (SIGTERM) 09:35:36.559501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20879): Terminating (SIGTERM) 09:35:36.599856 --- ParallelTerminationStrategy: PID 20873 died... 09:35:36.618659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20873): Terminated: ok {rc=0} 09:35:36.662681 --- ParallelTerminationStrategy: PID 20876 died... 09:35:36.681538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20876): Terminated: ok {rc=0} 09:35:36.725560 --- ParallelTerminationStrategy: PID 20879 died... 09:35:36.744240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20879): Terminated: ok {rc=0} 09:35:36.830033 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:35:38.142872 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:35:38.150020 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:35:38.182795 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:35:38.221956 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:35:38.309494 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:35:38.341875 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:35:38.380321 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:35:38.987791 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:35:39.038663 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.050353 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:35:39.099520 tst cs_paging_gprs_active.py: using LAC 20555 09:35:39.219735 tst cs_paging_gprs_active.py: using RAC 155 09:35:39.337351 tst cs_paging_gprs_active.py: using CellId 20555 09:35:39.460207 tst cs_paging_gprs_active.py: using BVCI 20556 09:35:39.571910 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.583363 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.594714 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.606180 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.617543 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.628803 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.640419 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.651777 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:39.663608 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:35:39.785241 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:35:39.902241 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:35:40.106001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:40.410336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20884): Launched 09:35:40.675691 run iperf3-srv_10.42.42.10(pid=20885): Launched 09:35:40.789457 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:35:40.992331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:41.298766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20886): Launched 09:35:41.563879 run iperf3-srv_10.42.42.10(pid=20887): Launched 09:35:41.677939 tst cs_paging_gprs_active.py:38: start network... 09:35:41.881058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:42.354535 run create_hlr_db(pid=20888): Launched 09:35:42.478534 bus /gobi_6: Setting Powered False 09:35:43.542529 run create_hlr_db(pid=20888): Terminated: ok {rc=0} 09:35:43.976689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20890): Launched 09:35:44.282233 run osmo-hlr_10.42.42.2(pid=20891): Launched 09:35:44.398671 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:44.938266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20893): Launched 09:35:45.242876 run osmo-stp_10.42.42.5(pid=20894): Launched 09:35:45.358570 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:45.925714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20896): Launched 09:35:46.044270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:46.308267 run patchelf(pid=20897): Launched 09:35:46.546998 run osmo-stp_10.42.42.5(pid=20894): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20894)] 09:35:46.682500 run osmo-stp_10.42.42.5(pid=20894): stdout: | (launched: 2022-12-09_09:35:45.186335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:46.815702 run osmo-stp_10.42.42.5(pid=20894): stderr: | [0;m[38;5;43m20221209093545360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093545360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093545360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093545360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093545361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093545361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093545361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:46.948522 run osmo-stp_10.42.42.5(pid=20894): stdout: | (launched: 2022-12-09_09:35:45.186335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:47.075631 run osmo-stp_10.42.42.5(pid=20894): stderr: | [0;m[38;5;43m20221209093545360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093545360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093545360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093545360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093545361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093545361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093545361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:47.226959 run patchelf(pid=20897): Terminating (SIGINT) 09:35:47.398602 run patchelf(pid=20897): Terminated: ok {rc=0} 09:35:47.521564 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20894): Process ended prematurely: osmo-stp_10.42.42.5(pid=20894) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20894)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:35:47.531244 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:35:47.558371 run osmo-hlr_10.42.42.2(pid=20891): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20891)] 09:35:47.606183 run osmo-hlr_10.42.42.2(pid=20891): stdout: | (launched: 2022-12-09_09:35:44.226603) 09:35:47.655628 run osmo-hlr_10.42.42.2(pid=20891): stderr: | [0;m[1;31m20221209093544403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093544403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093544403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093544403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093544403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093544404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093544414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093544423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093544423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093544423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:47.705500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20884): Terminating (SIGTERM) 09:35:47.745491 run iperf3-srv_10.42.42.10(pid=20885): Terminating (SIGTERM) 09:35:47.785284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20886): Terminating (SIGTERM) 09:35:47.825510 run iperf3-srv_10.42.42.10(pid=20887): Terminating (SIGTERM) 09:35:47.865380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20890): Terminating (SIGTERM) 09:35:47.905297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20893): Terminating (SIGTERM) 09:35:47.945121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20896): Terminating (SIGTERM) 09:35:47.985137 --- ParallelTerminationStrategy: PID 20884 died... 09:35:48.004203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20884): Terminated: ok {rc=0} 09:35:48.048351 --- ParallelTerminationStrategy: PID 20885 died... 09:35:48.066865 run iperf3-srv_10.42.42.10(pid=20885): Terminated {rc=256} 09:35:48.111153 --- ParallelTerminationStrategy: PID 20886 died... 09:35:48.129751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20886): Terminated: ok {rc=0} 09:35:48.173316 --- ParallelTerminationStrategy: PID 20887 died... 09:35:48.191923 run iperf3-srv_10.42.42.10(pid=20887): Terminated {rc=256} 09:35:48.235628 --- ParallelTerminationStrategy: PID 20890 died... 09:35:48.254233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20890): Terminated: ok {rc=0} 09:35:48.297819 --- ParallelTerminationStrategy: PID 20893 died... 09:35:48.316292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20893): Terminated: ok {rc=0} 09:35:48.359907 --- ParallelTerminationStrategy: PID 20896 died... 09:35:48.378712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20896): Terminated: ok {rc=0} 09:35:48.463394 bus /gobi_0: Setting Powered False 09:35:49.562971 bus /gobi_0: Setting Powered False 09:35:50.678632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:35:51.823936 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:51.836168 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:35:51.886124 tst iperf3.py: using LAC 20556 09:35:52.006624 tst iperf3.py: using RAC 156 09:35:52.126295 tst iperf3.py: using CellId 20556 09:35:52.251807 tst iperf3.py: using BVCI 20557 09:35:52.363136 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.374945 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.386406 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.397860 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.409230 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.420605 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.432115 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.443431 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:35:52.454944 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:35:52.579036 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:35:52.797188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:35:53.121661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20898): Launched 09:35:53.403070 run iperf3-srv_10.42.42.10(pid=20899): Launched 09:35:53.524760 tst iperf3.py:8: start network... 09:35:53.742377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:54.245129 run create_hlr_db(pid=20900): Launched 09:35:54.368659 bus /gobi_6: Setting Powered False 09:35:55.432312 run create_hlr_db(pid=20900): Terminated: ok {rc=0} 09:35:55.863581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Launched 09:35:56.166432 run osmo-hlr_10.42.42.2(pid=20903): Launched 09:35:56.282470 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:56.803852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Launched 09:35:57.107462 run osmo-stp_10.42.42.5(pid=20906): Launched 09:35:57.223530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:35:57.746873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20908): Launched 09:35:57.862212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:35:58.118261 run patchelf(pid=20909): Launched 09:35:58.285966 run osmo-stp_10.42.42.5(pid=20906): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] 09:35:58.413918 run osmo-stp_10.42.42.5(pid=20906): stdout: | (launched: 2022-12-09_09:35:57.051293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:58.543573 run osmo-stp_10.42.42.5(pid=20906): stderr: | [0;m[38;5;43m20221209093557222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093557222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093557222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093557222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093557223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093557223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093557223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:58.673292 run osmo-stp_10.42.42.5(pid=20906): stdout: | (launched: 2022-12-09_09:35:57.051293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:58.797323 run osmo-stp_10.42.42.5(pid=20906): stderr: | [0;m[38;5;43m20221209093557222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093557222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093557222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093557222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093557223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093557223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093557223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:58.943965 run patchelf(pid=20909): Terminating (SIGINT) 09:35:59.114215 run patchelf(pid=20909): Terminated: ok {rc=0} 09:35:59.236699 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20906): Process ended prematurely: osmo-stp_10.42.42.5(pid=20906) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:35:59.246368 tst iperf3.py:8: Test FAILED (7.5 sec) 09:35:59.273375 run osmo-hlr_10.42.42.2(pid=20903): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20903)] 09:35:59.321064 run osmo-hlr_10.42.42.2(pid=20903): stdout: | (launched: 2022-12-09_09:35:56.110817) 09:35:59.370767 run osmo-hlr_10.42.42.2(pid=20903): stderr: | [0;m[1;31m20221209093556286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093556286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093556286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093556286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093556286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093556286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093556303 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093556314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093556314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093556315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:59.420440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20898): Terminating (SIGTERM) 09:35:59.459758 run iperf3-srv_10.42.42.10(pid=20899): Terminating (SIGTERM) 09:35:59.499279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Terminating (SIGTERM) 09:35:59.539174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Terminating (SIGTERM) 09:35:59.578673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20908): Terminating (SIGTERM) 09:35:59.618409 --- ParallelTerminationStrategy: PID 20898 died... 09:35:59.637354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20898): Terminated: ok {rc=0} 09:35:59.681005 --- ParallelTerminationStrategy: PID 20899 died... 09:35:59.699700 run iperf3-srv_10.42.42.10(pid=20899): Terminated {rc=256} 09:35:59.743202 --- ParallelTerminationStrategy: PID 20902 died... 09:35:59.761753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20902): Terminated: ok {rc=0} 09:35:59.805387 --- ParallelTerminationStrategy: PID 20905 died... 09:35:59.824006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20905): Terminated: ok {rc=0} 09:35:59.867658 --- ParallelTerminationStrategy: PID 20908 died... 09:35:59.886248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20908): Terminated: ok {rc=0} 09:35:59.971979 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:36:01.151218 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.169354 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:36:01.246644 tst iperf3m4.py: using LAC 20557 09:36:01.402771 tst iperf3m4.py: using RAC 157 09:36:01.561687 tst iperf3m4.py: using CellId 20557 09:36:01.710835 tst iperf3m4.py: using BVCI 20558 09:36:01.833016 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.846381 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.859402 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.873701 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.887161 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.900092 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.913408 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.925900 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:01.939175 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:36:02.090442 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:36:02.238481 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:36:02.366101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:36:02.483264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:36:02.688248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:02.992313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20911): Launched 09:36:03.255634 run iperf3-srv_10.42.42.10(pid=20912): Launched 09:36:03.369734 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:36:03.572869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:03.877968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20913): Launched 09:36:04.140605 run iperf3-srv_10.42.42.10(pid=20914): Launched 09:36:04.254073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:36:04.456921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:04.760868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20915): Launched 09:36:05.024271 run iperf3-srv_10.42.42.10(pid=20916): Launched 09:36:05.138350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:36:05.341871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:36:05.647039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20917): Launched 09:36:05.910763 run iperf3-srv_10.42.42.10(pid=20918): Launched 09:36:06.024214 tst iperf3m4.py:8: start network... 09:36:06.227089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:06.697195 run create_hlr_db(pid=20919): Launched 09:36:06.819926 bus /gobi_6: Setting Powered False 09:36:07.879430 run create_hlr_db(pid=20919): Terminated: ok {rc=0} 09:36:08.320114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20921): Launched 09:36:08.644888 run osmo-hlr_10.42.42.2(pid=20922): Launched 09:36:08.769154 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:09.330071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20924): Launched 09:36:09.656474 run osmo-stp_10.42.42.5(pid=20925): Launched 09:36:09.781713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:10.342829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20927): Launched 09:36:10.467458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:10.741580 run patchelf(pid=20928): Launched 09:36:10.921115 run osmo-stp_10.42.42.5(pid=20925): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20925)] 09:36:11.057876 run osmo-stp_10.42.42.5(pid=20925): stdout: | (launched: 2022-12-09_09:36:09.596933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:11.196451 run osmo-stp_10.42.42.5(pid=20925): stderr: | [0;m[38;5;43m20221209093609788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093609789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093609789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093609789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093609790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093609790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093609790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:11.335207 run osmo-stp_10.42.42.5(pid=20925): stdout: | (launched: 2022-12-09_09:36:09.596933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:11.468654 run osmo-stp_10.42.42.5(pid=20925): stderr: | [0;m[38;5;43m20221209093609788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093609789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093609789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093609789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093609790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093609790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093609790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:11.626431 run patchelf(pid=20928): Terminating (SIGINT) 09:36:11.807555 run patchelf(pid=20928): Terminated: ok {rc=0} 09:36:11.938355 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20925): Process ended prematurely: osmo-stp_10.42.42.5(pid=20925) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20925)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:36:11.948511 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:36:11.977874 run osmo-hlr_10.42.42.2(pid=20922): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20922)] 09:36:12.028241 run osmo-hlr_10.42.42.2(pid=20922): stdout: | (launched: 2022-12-09_09:36:08.585762) 09:36:12.080125 run osmo-hlr_10.42.42.2(pid=20922): stderr: | [0;m[1;31m20221209093608785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093608785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093608785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093608785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093608785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093608785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093608797 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093608806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093608806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093608806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:12.132704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20911): Terminating (SIGTERM) 09:36:12.174790 run iperf3-srv_10.42.42.10(pid=20912): Terminating (SIGTERM) 09:36:12.216820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20913): Terminating (SIGTERM) 09:36:12.258741 run iperf3-srv_10.42.42.10(pid=20914): Terminating (SIGTERM) 09:36:12.300755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20915): Terminating (SIGTERM) 09:36:12.343302 run iperf3-srv_10.42.42.10(pid=20916): Terminating (SIGTERM) 09:36:12.385582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20917): Terminating (SIGTERM) 09:36:12.427774 run iperf3-srv_10.42.42.10(pid=20918): Terminating (SIGTERM) 09:36:12.469733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20921): Terminating (SIGTERM) 09:36:12.511828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20924): Terminating (SIGTERM) 09:36:12.553840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20927): Terminating (SIGTERM) 09:36:12.596032 --- ParallelTerminationStrategy: PID 20911 died... 09:36:12.616000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20911): Terminated: ok {rc=0} 09:36:12.662794 --- ParallelTerminationStrategy: PID 20912 died... 09:36:12.682574 run iperf3-srv_10.42.42.10(pid=20912): Terminated {rc=256} 09:36:12.729091 --- ParallelTerminationStrategy: PID 20913 died... 09:36:12.748691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20913): Terminated: ok {rc=0} 09:36:12.795436 --- ParallelTerminationStrategy: PID 20914 died... 09:36:12.814850 run iperf3-srv_10.42.42.10(pid=20914): Terminated {rc=256} 09:36:12.860876 --- ParallelTerminationStrategy: PID 20915 died... 09:36:12.880604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20915): Terminated: ok {rc=0} 09:36:12.926703 --- ParallelTerminationStrategy: PID 20916 died... 09:36:12.945997 run iperf3-srv_10.42.42.10(pid=20916): Terminated {rc=256} 09:36:12.992048 --- ParallelTerminationStrategy: PID 20917 died... 09:36:13.011341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20917): Terminated: ok {rc=0} 09:36:13.057568 --- ParallelTerminationStrategy: PID 20918 died... 09:36:13.077312 run iperf3-srv_10.42.42.10(pid=20918): Terminated {rc=256} 09:36:13.123484 --- ParallelTerminationStrategy: PID 20921 died... 09:36:13.142859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20921): Terminated: ok {rc=0} 09:36:13.188870 --- ParallelTerminationStrategy: PID 20924 died... 09:36:13.208655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20924): Terminated: ok {rc=0} 09:36:13.254682 --- ParallelTerminationStrategy: PID 20927 died... 09:36:13.274063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20927): Terminated: ok {rc=0} 09:36:13.361130 bus /gobi_4: Setting Powered False 09:36:14.459756 bus /gobi_4: Setting Powered False 09:36:15.574505 bus /gobi_1: Setting Powered False 09:36:16.672894 bus /gobi_1: Setting Powered False 09:36:17.794881 bus /gobi_0: Setting Powered False 09:36:18.891375 bus /gobi_0: Setting Powered False 09:36:20.006208 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:36:21.109105 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.121386 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:36:21.171120 tst ping.py: using LAC 20558 09:36:21.294348 tst ping.py: using RAC 158 09:36:21.420015 tst ping.py: using CellId 20558 09:36:21.544197 tst ping.py: using BVCI 20559 09:36:21.661201 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.673587 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.685423 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.697489 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.709478 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.721662 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.733833 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:21.745901 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:36:21.864048 tst ping.py:19: start network... 09:36:22.062843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:22.523626 run create_hlr_db(pid=20929): Launched 09:36:22.654195 bus /gobi_6: Setting Powered False 09:36:23.717287 run create_hlr_db(pid=20929): Terminated: ok {rc=0} 09:36:24.143268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20931): Launched 09:36:24.441424 run osmo-hlr_10.42.42.2(pid=20932): Launched 09:36:24.554564 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:25.071847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20934): Launched 09:36:25.369249 run osmo-stp_10.42.42.5(pid=20935): Launched 09:36:25.482119 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:25.997570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20937): Launched 09:36:26.110634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:26.360783 run patchelf(pid=20938): Launched 09:36:26.525730 run osmo-stp_10.42.42.5(pid=20935): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20935)] 09:36:26.651114 run osmo-stp_10.42.42.5(pid=20935): stdout: | (launched: 2022-12-09_09:36:25.313592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:26.778141 run osmo-stp_10.42.42.5(pid=20935): stderr: | [0;m[38;5;43m20221209093625486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093625486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093625486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093625487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093625487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093625487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093625487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:26.905395 run osmo-stp_10.42.42.5(pid=20935): stdout: | (launched: 2022-12-09_09:36:25.313592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:27.027491 run osmo-stp_10.42.42.5(pid=20935): stderr: | [0;m[38;5;43m20221209093625486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093625486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093625486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093625487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093625487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093625487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093625487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:27.171241 run patchelf(pid=20938): Terminating (SIGINT) 09:36:27.337751 run patchelf(pid=20938): Terminated: ok {rc=0} 09:36:27.458012 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20935): Process ended prematurely: osmo-stp_10.42.42.5(pid=20935) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20935)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:36:27.466822 tst ping.py:22: Test FAILED (6.4 sec) 09:36:27.493671 run osmo-hlr_10.42.42.2(pid=20932): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20932)] 09:36:27.541456 run osmo-hlr_10.42.42.2(pid=20932): stdout: | (launched: 2022-12-09_09:36:24.386070) 09:36:27.591232 run osmo-hlr_10.42.42.2(pid=20932): stderr: | [0;m[1;31m20221209093624560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093624561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093624561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093624561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093624561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093624561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093624572 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093624581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093624582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093624582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:27.641800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20931): Terminating (SIGTERM) 09:36:27.681798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20934): Terminating (SIGTERM) 09:36:27.721643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20937): Terminating (SIGTERM) 09:36:27.761748 --- ParallelTerminationStrategy: PID 20931 died... 09:36:27.780784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20931): Terminated: ok {rc=0} 09:36:27.825710 --- ParallelTerminationStrategy: PID 20934 died... 09:36:27.844075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20934): Terminated: ok {rc=0} 09:36:27.888244 --- ParallelTerminationStrategy: PID 20937 died... 09:36:27.906781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20937): Terminated: ok {rc=0} 09:36:27.992152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:36:29.079749 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.091994 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:36:29.145368 tst ping_idle_ping.py: using LAC 20559 09:36:29.265251 tst ping_idle_ping.py: using RAC 159 09:36:29.382832 tst ping_idle_ping.py: using CellId 20559 09:36:29.510758 tst ping_idle_ping.py: using BVCI 20560 09:36:29.627084 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.639320 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.651354 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.663654 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.676075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.688419 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.700933 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:36:29.712869 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:36:29.832756 tst ping_idle_ping.py:24: start network... 09:36:30.048715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:30.548241 run create_hlr_db(pid=20939): Launched 09:36:30.678692 bus /gobi_6: Setting Powered False 09:36:31.752509 run create_hlr_db(pid=20939): Terminated: ok {rc=0} 09:36:32.244649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20941): Launched 09:36:32.565545 run osmo-hlr_10.42.42.2(pid=20942): Launched 09:36:32.687591 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:33.218661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20944): Launched 09:36:33.516556 run osmo-stp_10.42.42.5(pid=20945): Launched 09:36:33.632287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:34.148442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20947): Launched 09:36:34.262160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:34.514517 run patchelf(pid=20948): Launched 09:36:34.680478 run osmo-stp_10.42.42.5(pid=20945): ERR: Terminated: ERROR {rc=1} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20945)] 09:36:34.806954 run osmo-stp_10.42.42.5(pid=20945): stdout: | (launched: 2022-12-09_09:36:33.461367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:34.934709 run osmo-stp_10.42.42.5(pid=20945): stderr: | [0;m[38;5;43m20221209093633629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093633629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093633629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093633630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093633630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093633630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093633630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:35.062954 run osmo-stp_10.42.42.5(pid=20945): stdout: | (launched: 2022-12-09_09:36:33.461367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:35.185487 run osmo-stp_10.42.42.5(pid=20945): stderr: | [0;m[38;5;43m20221209093633629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093633629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093633629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093633630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093633630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093633630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093633630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:35.330581 run patchelf(pid=20948): Terminating (SIGINT) 09:36:35.498068 run patchelf(pid=20948): Terminated: ok {rc=0} 09:36:35.619032 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20945): Process ended prematurely: osmo-stp_10.42.42.5(pid=20945) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20945)] [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:36:35.628645 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:36:35.655984 run osmo-hlr_10.42.42.2(pid=20942): ERR: Terminated: ERROR {rc=237} [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20942)] 09:36:35.703634 run osmo-hlr_10.42.42.2(pid=20942): stdout: | (launched: 2022-12-09_09:36:32.506480) 09:36:35.752839 run osmo-hlr_10.42.42.2(pid=20942): stderr: | [0;m[1;31m20221209093632704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093632704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093632704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093632704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093632704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093632704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093632717 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093632725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093632726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093632726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:35.802877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20941): Terminating (SIGTERM) 09:36:35.842929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20944): Terminating (SIGTERM) 09:36:35.883054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20947): Terminating (SIGTERM) 09:36:35.923140 --- ParallelTerminationStrategy: PID 20941 died... 09:36:35.942116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20941): Terminated: ok {rc=0} 09:36:35.986391 --- ParallelTerminationStrategy: PID 20944 died... 09:36:36.004756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20944): Terminated: ok {rc=0} 09:36:36.049210 --- ParallelTerminationStrategy: PID 20947 died... 09:36:36.067656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20947): Terminated: ok {rc=0} 09:36:36.153835 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:36:37.482692 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:36:37.490843 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:36:37.524557 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:36:37.560460 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:36:37.615242 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:36:37.648720 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:36:37.684512 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:36:38.250798 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2357 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:36:38.256062 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.268262 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:36:38.340770 tst switch_tch_pdch.py: using LAC 20560 09:36:38.465602 tst switch_tch_pdch.py: using RAC 160 09:36:38.588656 tst switch_tch_pdch.py: using CellId 20560 09:36:38.711513 tst switch_tch_pdch.py: using BVCI 20561 09:36:38.826699 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.838854 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.850780 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.862900 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.874905 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.886846 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.898963 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:36:38.911072 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:36:39.029182 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:36:39.151155 tst switch_tch_pdch.py:51: start network... 09:36:39.364742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:36:39.859519 run create_hlr_db(pid=20952): Launched 09:36:39.988460 bus /gobi_6: Setting Powered False 09:36:41.051965 run create_hlr_db(pid=20952): Terminated: ok {rc=0} 09:36:41.496028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20954): Launched 09:36:41.815526 run osmo-hlr_10.42.42.2(pid=20955): Launched 09:36:41.937479 run osmo-stp_10.42.42.5: Starting osmo-stp 09:36:42.491548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20957): Launched 09:36:42.811530 run osmo-stp_10.42.42.5(pid=20958): Launched 09:36:42.933840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:36:43.487671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20960): Launched 09:36:43.609444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:36:43.880369 run patchelf(pid=20961): Launched 09:36:44.057556 run osmo-stp_10.42.42.5(pid=20958): ERR: Terminated: ERROR {rc=1} [trial-2357↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20958)] 09:36:44.192740 run osmo-stp_10.42.42.5(pid=20958): stdout: | (launched: 2022-12-09_09:36:42.752832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:44.329784 run osmo-stp_10.42.42.5(pid=20958): stderr: | [0;m[38;5;43m20221209093642944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093642945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093642945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093642945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093642946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093642946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093642946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:44.467098 run osmo-stp_10.42.42.5(pid=20958): stdout: | (launched: 2022-12-09_09:36:42.752832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:36:44.598277 run osmo-stp_10.42.42.5(pid=20958): stderr: | [0;m[38;5;43m20221209093642944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093642945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093642945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093642945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093642946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093642946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093642946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:36:44.753542 run patchelf(pid=20961): Terminating (SIGINT) 09:36:44.932220 run patchelf(pid=20961): Terminated: ok {rc=0} 09:36:45.061148 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20958): Process ended prematurely: osmo-stp_10.42.42.5(pid=20958) [trial-2357↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20958)] [trial-2357↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:36:45.070852 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 09:36:45.098761 run osmo-hlr_10.42.42.2(pid=20955): ERR: Terminated: ERROR {rc=237} [trial-2357↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20955)] 09:36:45.148537 run osmo-hlr_10.42.42.2(pid=20955): stdout: | (launched: 2022-12-09_09:36:41.756627) 09:36:45.200184 run osmo-hlr_10.42.42.2(pid=20955): stderr: | [0;m[1;31m20221209093641955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093641955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093641955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093641955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093641955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093641955 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093641968 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093641976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093641976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093641976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:36:45.252223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20954): Terminating (SIGTERM) 09:36:45.294264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20957): Terminating (SIGTERM) 09:36:45.336136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20960): Terminating (SIGTERM) 09:36:45.378090 --- ParallelTerminationStrategy: PID 20954 died... 09:36:45.398278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20954): Terminated: ok {rc=0} 09:36:45.444471 --- ParallelTerminationStrategy: PID 20957 died... 09:36:45.463930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20957): Terminated: ok {rc=0} 09:36:45.509609 --- ParallelTerminationStrategy: PID 20960 died... 09:36:45.528898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20960): Terminated: ok {rc=0} 09:36:45.616706 bus /gobi_0: Setting Powered False 09:36:46.727942 bus /gobi_0: Setting Powered False 09:36:47.855795 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2357 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 nitb_smpp --------------------------------------------------------------------- 09:36:49.121503 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:36:49.124071 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 09:36:49.145624 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 09:36:49.152715 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 09:36:49.188534 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 09:36:49.209596 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 09:36:49.216714 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 09:36:49.736808 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2357 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:36:49.742260 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:36:49.760836 tst esme_connect_policy_acceptall.py: using MSISDN 7135 09:36:49.894432 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:36:50.462616 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20967): Launched 09:36:50.767113 run osmo-nitb_10.42.42.2(pid=20968): Launched 09:36:50.936037 run osmo-nitb_10.42.42.2(pid=20968): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20968)] 09:36:51.072564 run osmo-nitb_10.42.42.2(pid=20968): stdout: | (launched: 2022-12-09_09:36:50.711132) 09:36:51.210714 run osmo-nitb_10.42.42.2(pid=20968): stderr: | (launched: 2022-12-09_09:36:50.756476) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:36:51.348830 run osmo-nitb_10.42.42.2(pid=20968): stdout: | (launched: 2022-12-09_09:36:50.711132) 09:36:51.481332 run osmo-nitb_10.42.42.2(pid=20968): stderr: | (launched: 2022-12-09_09:36:50.756476) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20968): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20968) [trial-2357↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20968)] 09:36:51.882601 tst osmo-nitb_10.42.42.2(pid=20968): stdout: | (launched: 2022-12-09_09:36:50.711132) 09:36:52.006283 tst osmo-nitb_10.42.42.2(pid=20968): stderr: | (launched: 2022-12-09_09:36:50.756476) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:36:52.151596 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=20968): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20968) [trial-2357↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20968)] [trial-2357↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 09:36:52.160170 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 09:36:52.166933 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20967): Terminating (SIGTERM) 09:36:52.376607 --- ParallelTerminationStrategy: PID 20967 died... 09:36:52.397215 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20967): Terminated: ok {rc=0} ---------------------------------------------- trial-2357 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 09:36:52.446127 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:36:52.466922 tst esme_connect_policy_closed.py: using MSISDN 7136 09:36:52.590852 tst esme_connect_policy_closed.py: using MSISDN 7137 09:36:52.701387 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:36:53.267604 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20969): Launched 09:36:53.573707 run osmo-nitb_10.42.42.2(pid=20970): Launched 09:36:53.739147 run osmo-nitb_10.42.42.2(pid=20970): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20970)] 09:36:53.865565 run osmo-nitb_10.42.42.2(pid=20970): stdout: | (launched: 2022-12-09_09:36:53.517295) 09:36:53.992812 run osmo-nitb_10.42.42.2(pid=20970): stderr: | (launched: 2022-12-09_09:36:53.563109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:36:54.120109 run osmo-nitb_10.42.42.2(pid=20970): stdout: | (launched: 2022-12-09_09:36:53.517295) 09:36:54.241657 run osmo-nitb_10.42.42.2(pid=20970): stderr: | (launched: 2022-12-09_09:36:53.563109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:36:54.387438 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=20970): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20970) [trial-2357↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20970)] [trial-2357↪nitb_smpp↪esme_connect_policy_closed.py:24] 09:36:54.395916 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 09:36:54.402407 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20969): Terminating (SIGTERM) 09:36:54.611308 --- ParallelTerminationStrategy: PID 20969 died... 09:36:54.631715 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20969): Terminated: ok {rc=0} ---------------------------------------------- trial-2357 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:36:54.680906 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:36:54.692194 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:36:54.733022 tst esme_ms_sms_storeforward.py: using LAC 20561 09:36:54.854885 tst esme_ms_sms_storeforward.py: using RAC 161 09:36:54.974850 tst esme_ms_sms_storeforward.py: using CellId 20561 09:36:55.093025 tst esme_ms_sms_storeforward.py: using BVCI 20562 09:36:55.203723 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:36:55.334880 tst esme_ms_sms_storeforward.py: using MSISDN 7138 09:36:55.454968 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 09:36:55.674652 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:36:56.339634 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20971): Launched 09:36:56.668533 run osmo-nitb_10.42.42.2(pid=20972): Launched 09:36:56.845091 run osmo-nitb_10.42.42.2(pid=20972): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20972)] 09:36:56.979848 run osmo-nitb_10.42.42.2(pid=20972): stdout: | (launched: 2022-12-09_09:36:56.608216) 09:36:57.115861 run osmo-nitb_10.42.42.2(pid=20972): stderr: | (launched: 2022-12-09_09:36:56.657342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:36:57.252015 run osmo-nitb_10.42.42.2(pid=20972): stdout: | (launched: 2022-12-09_09:36:56.608216) 09:36:57.382047 run osmo-nitb_10.42.42.2(pid=20972): stderr: | (launched: 2022-12-09_09:36:56.657342) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:36:57.538349 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=20972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20972) [trial-2357↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20972)] [trial-2357↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 09:36:57.547248 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 09:36:57.554175 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20971): Terminating (SIGTERM) 09:36:57.764182 --- ParallelTerminationStrategy: PID 20971 died... 09:36:57.785466 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20971): Terminated: ok {rc=0} 09:36:57.873094 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:36:58.961701 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:36:58.973933 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:36:59.012226 tst esme_ms_sms_transaction.py: using LAC 20562 09:36:59.142400 tst esme_ms_sms_transaction.py: using RAC 162 09:36:59.269532 tst esme_ms_sms_transaction.py: using CellId 20562 09:36:59.392877 tst esme_ms_sms_transaction.py: using BVCI 20563 09:36:59.504175 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:36:59.636234 tst esme_ms_sms_transaction.py: using MSISDN 7139 09:36:59.756180 tst esme_ms_sms_transaction.py:18: start nitb and bts... 09:36:59.977007 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:37:00.638751 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20973): Launched 09:37:00.986558 run osmo-nitb_10.42.42.2(pid=20974): Launched 09:37:01.191825 run osmo-nitb_10.42.42.2(pid=20974): ERR: Terminated: ERROR {rc=2} [trial-2357↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20974)] 09:37:01.340081 run osmo-nitb_10.42.42.2(pid=20974): stdout: | (launched: 2022-12-09_09:37:00.915434) 09:37:01.490160 run osmo-nitb_10.42.42.2(pid=20974): stderr: | (launched: 2022-12-09_09:37:00.972338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:37:01.639901 run osmo-nitb_10.42.42.2(pid=20974): stdout: | (launched: 2022-12-09_09:37:00.915434) 09:37:01.784390 run osmo-nitb_10.42.42.2(pid=20974): stderr: | (launched: 2022-12-09_09:37:00.972338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbcac56d268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20974): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20974) [trial-2357↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20974)] 09:37:02.133218 tst osmo-nitb_10.42.42.2(pid=20974): stdout: | (launched: 2022-12-09_09:37:00.915434) 09:37:02.257620 tst osmo-nitb_10.42.42.2(pid=20974): stderr: | (launched: 2022-12-09_09:37:00.972338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:37:02.403243 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=20974): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20974) [trial-2357↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20974)] [trial-2357↪nitb_smpp↪esme_ms_sms_transaction.py:21] 09:37:02.411827 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 09:37:02.418934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20973): Terminating (SIGTERM) 09:37:02.629718 --- ParallelTerminationStrategy: PID 20973 died... 09:37:02.650671 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20973): Terminated: ok {rc=0} 09:37:02.737937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 smpp --------------------------------------------------------------------- 09:37:03.910111 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:37:03.913095 tst smpp: Verifying 1 x bts (candidates: 11) 09:37:03.934239 tst smpp: Verifying 6 x ip_address (candidates: 9) 09:37:03.963851 tst smpp: Verifying 1 x modem (candidates: 12) 09:37:03.998807 tst smpp: Reserving 1 x bts (candidates: 11) 09:37:04.020532 tst smpp: Reserving 6 x ip_address (candidates: 9) 09:37:04.048554 tst smpp: Reserving 1 x modem (candidates: 12) 09:37:04.578639 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:37:04.584369 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:04.595547 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:04.607128 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:04.619155 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:04.638368 tst esme_connect_policy_acceptall.py: using MSISDN 7140 09:37:04.758327 run osmo-stp_10.42.42.4: Starting osmo-stp 09:37:05.314965 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20979): Launched 09:37:05.643401 run osmo-stp_10.42.42.4(pid=20980): Launched 09:37:05.768615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:06.278727 run create_hlr_db(pid=20981): Launched 09:37:06.413968 bus /sierra_2: Setting Powered False 09:37:07.478139 run create_hlr_db(pid=20981): Terminated: ok {rc=0} 09:37:07.937675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20983): Launched 09:37:08.268326 run osmo-hlr_10.42.42.2(pid=20984): Launched 09:37:08.394355 run osmo-msc_10.42.42.5: Starting osmo-msc 09:37:08.998591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20986): Launched 09:37:09.329782 run osmo-msc_10.42.42.5(pid=20987): Launched 09:37:09.515274 run osmo-hlr_10.42.42.2(pid=20984): ERR: Terminated: ERROR {rc=237} [trial-2357↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20984)] 09:37:09.656684 run osmo-hlr_10.42.42.2(pid=20984): stdout: | (launched: 2022-12-09_09:37:08.207822) 09:37:09.796859 run osmo-hlr_10.42.42.2(pid=20984): stderr: | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093708415 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093708424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093708424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093708424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:09.936579 run osmo-hlr_10.42.42.2(pid=20984): stdout: | (launched: 2022-12-09_09:37:08.207822) 09:37:10.068365 run osmo-hlr_10.42.42.2(pid=20984): stderr: | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093708402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093708415 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093708424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093708424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093708424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:10.226310 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=20984): Process ended prematurely: osmo-hlr_10.42.42.2(pid=20984) [trial-2357↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20984)] [trial-2357↪smpp↪esme_connect_policy_acceptall.py:23] 09:37:10.235279 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 09:37:10.262971 run osmo-msc_10.42.42.5(pid=20987): ERR: Terminated: ERROR {rc=9} [trial-2357↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=20987)] 09:37:10.313623 run osmo-msc_10.42.42.5(pid=20987): stdout: | (launched: 2022-12-09_09:37:09.268315) 09:37:10.365606 run osmo-msc_10.42.42.5(pid=20987): stderr: | [0;m[38;5;43m20221209093709633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209093709633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209093709633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209093709634 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209093709634 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209093709634 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209093709634 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209093709634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209093709634 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:37:10.418089 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20979): Terminating (SIGTERM) 09:37:10.459825 run osmo-stp_10.42.42.4(pid=20980): Terminating (SIGTERM) 09:37:10.501360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20983): Terminating (SIGTERM) 09:37:10.544733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20986): Terminating (SIGTERM) 09:37:10.589677 --- ParallelTerminationStrategy: PID 20979 died... 09:37:10.610240 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20979): Terminated: ok {rc=0} 09:37:10.659168 --- ParallelTerminationStrategy: PID 20980 died... 09:37:10.678982 run osmo-stp_10.42.42.4(pid=20980): Terminated: ok {rc=0} 09:37:10.725320 --- ParallelTerminationStrategy: PID 20983 died... 09:37:10.744885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20983): Terminated: ok {rc=0} 09:37:10.791218 --- ParallelTerminationStrategy: PID 20986 died... 09:37:10.810895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20986): Terminated: ok {rc=0} ---------------------------------------------- trial-2357 smpp esme_connect_policy_closed.py ---------------------------------------------- 09:37:10.862080 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:10.873917 tst smpp: Using 1 x bts (candidates: 1) 09:37:10.910060 tst esme_connect_policy_closed.py: using LAC 20563 09:37:11.042300 tst esme_connect_policy_closed.py: using RAC 163 09:37:11.173479 tst esme_connect_policy_closed.py: using CellId 20563 09:37:11.303380 tst esme_connect_policy_closed.py: using BVCI 20564 09:37:11.426374 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:11.437643 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:11.448717 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:11.472897 tst esme_connect_policy_closed.py: using MSISDN 7141 09:37:11.595348 tst esme_connect_policy_closed.py: using MSISDN 7142 09:37:11.708570 run osmo-stp_10.42.42.4: Starting osmo-stp 09:37:12.237894 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20990): Launched 09:37:12.551146 run osmo-stp_10.42.42.4(pid=20991): Launched 09:37:12.670881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:13.154098 run create_hlr_db(pid=20992): Launched 09:37:14.328874 run create_hlr_db(pid=20992): Terminated: ok {rc=0} 09:37:14.657670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20994): Launched 09:37:14.969709 run osmo-hlr_10.42.42.2(pid=20995): Launched 09:37:15.088998 run osmo-msc_10.42.42.5: Starting osmo-msc 09:37:15.653129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20997): Launched 09:37:15.993730 run osmo-msc_10.42.42.5(pid=20998): Launched 09:37:16.287722 run osmo-hlr_10.42.42.2(pid=20995): ERR: Terminated: ERROR {rc=237} [trial-2357↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20995)] 09:37:16.493616 run osmo-hlr_10.42.42.2(pid=20995): stdout: | (launched: 2022-12-09_09:37:14.912233) 09:37:16.711995 run osmo-hlr_10.42.42.2(pid=20995): stderr: | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093715087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093715098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093715106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093715106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093715106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:16.951499 run osmo-hlr_10.42.42.2(pid=20995): stdout: | (launched: 2022-12-09_09:37:14.912233) 09:37:17.089731 run osmo-hlr_10.42.42.2(pid=20995): stderr: | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093715086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093715087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093715098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093715106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093715106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093715106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:17.253245 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=20995): Process ended prematurely: osmo-hlr_10.42.42.2(pid=20995) [trial-2357↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20995)] [trial-2357↪smpp↪esme_connect_policy_closed.py:31] 09:37:17.263329 tst esme_connect_policy_closed.py:31: Test FAILED (6.4 sec) 09:37:17.295473 run osmo-msc_10.42.42.5(pid=20998): ERR: Terminated: ERROR {rc=9} [trial-2357↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=20998)] 09:37:17.348518 run osmo-msc_10.42.42.5(pid=20998): stdout: | (launched: 2022-12-09_09:37:15.927995) 09:37:17.404688 run osmo-msc_10.42.42.5(pid=20998): stderr: | [0;m[38;5;43m20221209093716620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209093716620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209093716625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209093716625 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209093716625 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209093716625 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209093716625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209093716625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209093716625 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:37:17.458929 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20990): Terminating (SIGTERM) 09:37:17.502424 run osmo-stp_10.42.42.4(pid=20991): Terminating (SIGTERM) 09:37:17.545890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20994): Terminating (SIGTERM) 09:37:17.591380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20997): Terminating (SIGTERM) 09:37:17.637619 --- ParallelTerminationStrategy: PID 20990 died... 09:37:17.658505 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20990): Terminated: ok {rc=0} 09:37:17.709122 --- ParallelTerminationStrategy: PID 20991 died... 09:37:17.728882 run osmo-stp_10.42.42.4(pid=20991): Terminated: ok {rc=0} 09:37:17.776817 --- ParallelTerminationStrategy: PID 20994 died... 09:37:17.797043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20994): Terminated: ok {rc=0} 09:37:17.845054 --- ParallelTerminationStrategy: PID 20997 died... 09:37:17.865060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20997): Terminated: ok {rc=0} ---------------------------------------------- trial-2357 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:37:17.917978 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:17.930021 tst smpp: Using 1 x bts (candidates: 1) 09:37:17.967789 tst esme_ms_sms_storeforward.py: using LAC 20564 09:37:18.100814 tst esme_ms_sms_storeforward.py: using RAC 164 09:37:18.231904 tst esme_ms_sms_storeforward.py: using CellId 20564 09:37:18.364437 tst esme_ms_sms_storeforward.py: using BVCI 20565 09:37:18.479827 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:18.490832 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:18.501554 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:18.512599 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:18.523717 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:18.534733 tst smpp: Using 1 x modem (candidates: 1) 09:37:18.670108 tst esme_ms_sms_storeforward.py: using MSISDN 7143 09:37:18.793177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:19.310735 run create_hlr_db(pid=21001): Launched 09:37:20.507666 run create_hlr_db(pid=21001): Terminated: ok {rc=0} 09:37:20.858607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21003): Launched 09:37:21.193271 run osmo-hlr_10.42.42.2(pid=21004): Launched 09:37:21.320893 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:21.899772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21006): Launched 09:37:22.235621 run osmo-stp_10.42.42.5(pid=21007): Launched 09:37:22.364410 run osmo-msc_10.42.42.6: Starting osmo-msc 09:37:22.964494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21009): Launched 09:37:23.296405 run osmo-msc_10.42.42.6(pid=21010): Launched 09:37:23.483879 run osmo-stp_10.42.42.5(pid=21007): ERR: Terminated: ERROR {rc=1} [trial-2357↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21007)] 09:37:23.623314 run osmo-stp_10.42.42.5(pid=21007): stdout: | (launched: 2022-12-09_09:37:22.174488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:23.763654 run osmo-stp_10.42.42.5(pid=21007): stderr: | [0;m[38;5;43m20221209093722371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093722371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093722371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093722372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093722372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093722372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093722372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:23.902353 run osmo-stp_10.42.42.5(pid=21007): stdout: | (launched: 2022-12-09_09:37:22.174488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:24.035059 run osmo-stp_10.42.42.5(pid=21007): stderr: | [0;m[38;5;43m20221209093722371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093722371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093722371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093722372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093722372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093722372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093722372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:24.193151 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=21007): Process ended prematurely: osmo-stp_10.42.42.5(pid=21007) [trial-2357↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21007)] [trial-2357↪smpp↪esme_ms_sms_storeforward.py:30] 09:37:24.202313 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 09:37:24.229672 run osmo-hlr_10.42.42.2(pid=21004): ERR: Terminated: ERROR {rc=237} [trial-2357↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21004)] 09:37:24.279942 run osmo-hlr_10.42.42.2(pid=21004): stdout: | (launched: 2022-12-09_09:37:21.132258) 09:37:24.331757 run osmo-hlr_10.42.42.2(pid=21004): stderr: | [0;m[1;31m20221209093721334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093721334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093721334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093721334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093721334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093721334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093721347 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093721355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093721356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093721356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:24.404030 run osmo-msc_10.42.42.6(pid=21010): ERR: Terminated: ERROR {rc=2} [trial-2357↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21010)] 09:37:24.454425 run osmo-msc_10.42.42.6(pid=21010): stdout: | (launched: 2022-12-09_09:37:23.235512) 09:37:24.506230 run osmo-msc_10.42.42.6(pid=21010): stderr: | [0;m[38;5;43m20221209093723560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093723560 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff40d3b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093723561 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093723561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093723561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093723561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093723563 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093723563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093723563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093723563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:37:24.558297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21003): Terminating (SIGTERM) 09:37:24.600022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21006): Terminating (SIGTERM) 09:37:24.641841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21009): Terminating (SIGTERM) 09:37:24.683696 --- ParallelTerminationStrategy: PID 21003 died... 09:37:24.703550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21003): Terminated: ok {rc=0} 09:37:24.749808 --- ParallelTerminationStrategy: PID 21006 died... 09:37:24.769419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21006): Terminated: ok {rc=0} 09:37:24.815170 --- ParallelTerminationStrategy: PID 21009 died... 09:37:24.834759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21009): Terminated: ok {rc=0} 09:37:24.922716 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:37:26.009159 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:26.020599 tst smpp: Using 1 x bts (candidates: 1) 09:37:26.058282 tst esme_ms_sms_transaction.py: using LAC 20565 09:37:26.182900 tst esme_ms_sms_transaction.py: using RAC 165 09:37:26.306340 tst esme_ms_sms_transaction.py: using CellId 20565 09:37:26.431886 tst esme_ms_sms_transaction.py: using BVCI 20566 09:37:26.554150 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:26.565463 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:26.577996 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:26.589145 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:26.600078 tst smpp: Using 1 x ip_address (candidates: 6) 09:37:26.611105 tst smpp: Using 1 x modem (candidates: 1) 09:37:26.738658 tst esme_ms_sms_transaction.py: using MSISDN 7144 09:37:26.854264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:27.335494 run create_hlr_db(pid=21012): Launched 09:37:27.454831 bus /sierra_2: Setting Powered False 09:37:28.516569 run create_hlr_db(pid=21012): Terminated: ok {rc=0} 09:37:28.970799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Launched 09:37:29.304349 run osmo-hlr_10.42.42.2(pid=21015): Launched 09:37:29.434578 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:30.007236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Launched 09:37:30.342333 run osmo-stp_10.42.42.5(pid=21018): Launched 09:37:30.470823 run osmo-msc_10.42.42.6: Starting osmo-msc 09:37:31.093848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21020): Launched 09:37:31.437712 run osmo-msc_10.42.42.6(pid=21021): Launched 09:37:31.777456 run osmo-stp_10.42.42.5(pid=21018): ERR: Terminated: ERROR {rc=1} [trial-2357↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] 09:37:31.950473 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-09_09:37:30.280534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:32.114080 run osmo-stp_10.42.42.5(pid=21018): stderr: | [0;m[38;5;43m20221209093730478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093730478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093730478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093730479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093730479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093730479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093730479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:32.271873 run osmo-stp_10.42.42.5(pid=21018): stdout: | (launched: 2022-12-09_09:37:30.280534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:32.427248 run osmo-stp_10.42.42.5(pid=21018): stderr: | [0;m[38;5;43m20221209093730478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093730478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093730478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093730479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093730479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093730479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093730479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:32.586156 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2357↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] [trial-2357↪smpp↪esme_ms_sms_transaction.py:28] 09:37:32.595377 tst esme_ms_sms_transaction.py:28: Test FAILED (6.6 sec) 09:37:32.623433 run osmo-hlr_10.42.42.2(pid=21015): ERR: Terminated: ERROR {rc=237} [trial-2357↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21015)] 09:37:32.674822 run osmo-hlr_10.42.42.2(pid=21015): stdout: | (launched: 2022-12-09_09:37:29.243097) 09:37:32.727891 run osmo-hlr_10.42.42.2(pid=21015): stderr: | [0;m[1;31m20221209093729444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093729444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093729444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093729444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093729444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093729444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093729456 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093729466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093729467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093729467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:32.801870 run osmo-msc_10.42.42.6(pid=21021): ERR: Terminated: ERROR {rc=2} [trial-2357↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21021)] 09:37:32.853163 run osmo-msc_10.42.42.6(pid=21021): stdout: | (launched: 2022-12-09_09:37:31.372685) 09:37:32.906205 run osmo-msc_10.42.42.6(pid=21021): stderr: | [0;m[38;5;43m20221209093731999 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093731999 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa65c6d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093731999 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093731999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093731999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093732000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093732015 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093732015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093732015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093732015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:37:32.959345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminating (SIGTERM) 09:37:33.002019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminating (SIGTERM) 09:37:33.044254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21020): Terminating (SIGTERM) 09:37:33.086771 --- ParallelTerminationStrategy: PID 21014 died... 09:37:33.107250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21014): Terminated: ok {rc=0} 09:37:33.154861 --- ParallelTerminationStrategy: PID 21017 died... 09:37:33.174879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21017): Terminated: ok {rc=0} 09:37:33.222098 --- ParallelTerminationStrategy: PID 21020 died... 09:37:33.242065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21020): Terminated: ok {rc=0} 09:37:33.330990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 encryption --------------------------------------------------------------------- 09:37:34.529122 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:37:34.532642 tst encryption: Verifying 1 x bts (candidates: 11) 09:37:34.555089 tst encryption: Verifying 6 x ip_address (candidates: 9) 09:37:34.583106 tst encryption: Verifying 1 x modem (candidates: 12) 09:37:34.619078 tst encryption: Reserving 1 x bts (candidates: 11) 09:37:34.641370 tst encryption: Reserving 6 x ip_address (candidates: 9) 09:37:34.669495 tst encryption: Reserving 1 x modem (candidates: 12) 09:37:35.199935 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2357 encryption register_a5_0_authopt.py ---------------------------------------------- 09:37:35.256451 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:35.267659 tst encryption: Using 1 x bts (candidates: 1) 09:37:35.304878 tst register_a5_0_authopt.py: using LAC 20566 09:37:35.438177 tst register_a5_0_authopt.py: using RAC 166 09:37:35.576438 tst register_a5_0_authopt.py: using CellId 20566 09:37:35.709143 tst register_a5_0_authopt.py: using BVCI 20567 09:37:35.834311 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:35.845607 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:35.856681 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:35.867840 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:35.878992 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:35.890076 tst encryption: Using 1 x modem (candidates: 1) 09:37:36.006080 tst register_a5_0_authopt.py:8: start network... 09:37:36.219511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:36.707782 run create_hlr_db(pid=21026): Launched 09:37:36.827855 bus /sierra_2: Setting Powered False 09:37:37.889848 run create_hlr_db(pid=21026): Terminated: ok {rc=0} 09:37:38.328681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21028): Launched 09:37:38.644617 run osmo-hlr_10.42.42.2(pid=21029): Launched 09:37:38.765557 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:39.318564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21031): Launched 09:37:39.633953 run osmo-stp_10.42.42.5(pid=21032): Launched 09:37:39.755490 run osmo-msc_10.42.42.6: Starting osmo-msc 09:37:40.324131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21034): Launched 09:37:40.639220 run osmo-msc_10.42.42.6(pid=21035): Launched 09:37:40.816102 run osmo-stp_10.42.42.5(pid=21032): ERR: Terminated: ERROR {rc=1} [trial-2357↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21032)] 09:37:40.949290 run osmo-stp_10.42.42.5(pid=21032): stdout: | (launched: 2022-12-09_09:37:39.575424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:41.081765 run osmo-stp_10.42.42.5(pid=21032): stderr: | [0;m[38;5;43m20221209093739750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093739750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093739750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093739751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093739751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093739751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093739751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:41.211948 run osmo-stp_10.42.42.5(pid=21032): stdout: | (launched: 2022-12-09_09:37:39.575424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:41.336831 run osmo-stp_10.42.42.5(pid=21032): stderr: | [0;m[38;5;43m20221209093739750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093739750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093739750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093739751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093739751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093739751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093739751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:41.486567 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21032): Process ended prematurely: osmo-stp_10.42.42.5(pid=21032) [trial-2357↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21032)] [trial-2357↪encryption↪register_a5_0_authopt.py:8] 09:37:41.495470 tst register_a5_0_authopt.py:8: Test FAILED (6.3 sec) 09:37:41.522266 run osmo-hlr_10.42.42.2(pid=21029): ERR: Terminated: ERROR {rc=237} [trial-2357↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21029)] 09:37:41.570308 run osmo-hlr_10.42.42.2(pid=21029): stdout: | (launched: 2022-12-09_09:37:38.586422) 09:37:41.620002 run osmo-hlr_10.42.42.2(pid=21029): stderr: | [0;m[1;31m20221209093738765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093738765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093738765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093738765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093738765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093738766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093738778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093738786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093738786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093738786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:41.689260 run osmo-msc_10.42.42.6(pid=21035): ERR: Terminated: ERROR {rc=2} [trial-2357↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21035)] 09:37:41.737321 run osmo-msc_10.42.42.6(pid=21035): stdout: | (launched: 2022-12-09_09:37:40.581782) 09:37:41.787045 run osmo-msc_10.42.42.6(pid=21035): stderr: | [0;m[38;5;43m20221209093740854 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093740855 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f746184cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093740855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093740855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093740855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093740855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093740857 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093740857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093740857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093740857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:37:41.837142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21028): Terminating (SIGTERM) 09:37:41.877241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21031): Terminating (SIGTERM) 09:37:41.917602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21034): Terminating (SIGTERM) 09:37:41.958450 --- ParallelTerminationStrategy: PID 21028 died... 09:37:41.977788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21028): Terminated: ok {rc=0} 09:37:42.022701 --- ParallelTerminationStrategy: PID 21031 died... 09:37:42.041510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21031): Terminated: ok {rc=0} 09:37:42.086351 --- ParallelTerminationStrategy: PID 21034 died... 09:37:42.105262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21034): Terminated: ok {rc=0} 09:37:42.192856 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 encryption register_a5_0_authreq.py ---------------------------------------------- 09:37:43.343322 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:43.354843 tst encryption: Using 1 x bts (candidates: 1) 09:37:43.392692 tst register_a5_0_authreq.py: using LAC 20567 09:37:43.525845 tst register_a5_0_authreq.py: using RAC 167 09:37:43.657333 tst register_a5_0_authreq.py: using CellId 20567 09:37:43.788600 tst register_a5_0_authreq.py: using BVCI 20568 09:37:43.910679 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:43.921924 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:43.933079 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:43.944014 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:43.955111 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:43.966092 tst encryption: Using 1 x modem (candidates: 1) 09:37:44.084018 tst register_a5_0_authreq.py:8: start network... 09:37:44.297797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:44.785611 run create_hlr_db(pid=21037): Launched 09:37:44.905490 bus /sierra_2: Setting Powered False 09:37:45.979035 run create_hlr_db(pid=21037): Terminated: ok {rc=0} 09:37:46.521202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21039): Launched 09:37:46.921666 run osmo-hlr_10.42.42.2(pid=21040): Launched 09:37:47.136652 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:47.722994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21042): Launched 09:37:48.059422 run osmo-stp_10.42.42.5(pid=21043): Launched 09:37:48.189158 run osmo-msc_10.42.42.6: Starting osmo-msc 09:37:48.796592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21045): Launched 09:37:49.135619 run osmo-msc_10.42.42.6(pid=21046): Launched 09:37:49.324461 run osmo-stp_10.42.42.5(pid=21043): ERR: Terminated: ERROR {rc=1} [trial-2357↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21043)] 09:37:49.466326 run osmo-stp_10.42.42.5(pid=21043): stdout: | (launched: 2022-12-09_09:37:47.998358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:49.607935 run osmo-stp_10.42.42.5(pid=21043): stderr: | [0;m[38;5;43m20221209093748192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093748193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093748193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093748193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093748194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093748194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093748194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:49.747450 run osmo-stp_10.42.42.5(pid=21043): stdout: | (launched: 2022-12-09_09:37:47.998358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:49.881117 run osmo-stp_10.42.42.5(pid=21043): stderr: | [0;m[38;5;43m20221209093748192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093748193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093748193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093748193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093748194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093748194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093748194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:50.041041 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21043): Process ended prematurely: osmo-stp_10.42.42.5(pid=21043) [trial-2357↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21043)] [trial-2357↪encryption↪register_a5_0_authreq.py:8] 09:37:50.050580 tst register_a5_0_authreq.py:8: Test FAILED (6.7 sec) 09:37:50.078163 run osmo-hlr_10.42.42.2(pid=21040): ERR: Terminated: ERROR {rc=237} [trial-2357↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21040)] 09:37:50.128239 run osmo-hlr_10.42.42.2(pid=21040): stdout: | (launched: 2022-12-09_09:37:46.849528) 09:37:50.179897 run osmo-hlr_10.42.42.2(pid=21040): stderr: | [0;m[1;31m20221209093747210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093747210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093747210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093747211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093747211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093747211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093747231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093747244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093747265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093747265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:50.252692 run osmo-msc_10.42.42.6(pid=21046): ERR: Terminated: ERROR {rc=2} [trial-2357↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21046)] 09:37:50.302890 run osmo-msc_10.42.42.6(pid=21046): stdout: | (launched: 2022-12-09_09:37:49.074069) 09:37:50.354549 run osmo-msc_10.42.42.6(pid=21046): stderr: | [0;m[38;5;43m20221209093749399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093749399 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06d9c4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093749399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093749399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093749400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093749400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093749401 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093749402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093749402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093749402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:37:50.406538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21039): Terminating (SIGTERM) 09:37:50.448660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21042): Terminating (SIGTERM) 09:37:50.490951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21045): Terminating (SIGTERM) 09:37:50.533613 --- ParallelTerminationStrategy: PID 21039 died... 09:37:50.553805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21039): Terminated: ok {rc=0} 09:37:50.600406 --- ParallelTerminationStrategy: PID 21042 died... 09:37:50.620199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21042): Terminated: ok {rc=0} 09:37:50.667169 --- ParallelTerminationStrategy: PID 21045 died... 09:37:50.686855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21045): Terminated: ok {rc=0} 09:37:50.775472 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 encryption register_a5_1_authreq.py ---------------------------------------------- 09:37:51.928581 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:51.940457 tst encryption: Using 1 x bts (candidates: 1) 09:37:51.977739 tst register_a5_1_authreq.py: using LAC 20568 09:37:52.111064 tst register_a5_1_authreq.py: using RAC 168 09:37:52.244908 tst register_a5_1_authreq.py: using CellId 20568 09:37:52.376908 tst register_a5_1_authreq.py: using BVCI 20569 09:37:52.499695 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:52.510914 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:52.522101 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:52.533147 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:52.544075 tst encryption: Using 1 x ip_address (candidates: 6) 09:37:52.555045 tst encryption: Using 1 x modem (candidates: 1) 09:37:52.675786 tst register_a5_1_authreq.py:8: start network... 09:37:52.903361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:37:53.426048 run create_hlr_db(pid=21048): Launched 09:37:53.562997 bus /sierra_2: Setting Powered False 09:37:54.628730 run create_hlr_db(pid=21048): Terminated: ok {rc=0} 09:37:55.094574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21050): Launched 09:37:55.431598 run osmo-hlr_10.42.42.2(pid=21051): Launched 09:37:55.561255 run osmo-stp_10.42.42.5: Starting osmo-stp 09:37:56.142909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21053): Launched 09:37:56.482137 run osmo-stp_10.42.42.5(pid=21054): Launched 09:37:56.610897 run osmo-msc_10.42.42.6: Starting osmo-msc 09:37:57.216705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21056): Launched 09:37:57.555965 run osmo-msc_10.42.42.6(pid=21057): Launched 09:37:57.744847 run osmo-stp_10.42.42.5(pid=21054): ERR: Terminated: ERROR {rc=1} [trial-2357↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21054)] 09:37:57.886406 run osmo-stp_10.42.42.5(pid=21054): stdout: | (launched: 2022-12-09_09:37:56.418973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:58.028423 run osmo-stp_10.42.42.5(pid=21054): stderr: | [0;m[38;5;43m20221209093756615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093756615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093756615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093756616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093756616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093756616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093756616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:58.168246 run osmo-stp_10.42.42.5(pid=21054): stdout: | (launched: 2022-12-09_09:37:56.418973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:37:58.302949 run osmo-stp_10.42.42.5(pid=21054): stderr: | [0;m[38;5;43m20221209093756615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093756615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093756615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093756616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093756616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093756616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093756616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:37:58.463996 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21054): Process ended prematurely: osmo-stp_10.42.42.5(pid=21054) [trial-2357↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21054)] [trial-2357↪encryption↪register_a5_1_authreq.py:8] 09:37:58.473737 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 09:37:58.502033 run osmo-hlr_10.42.42.2(pid=21051): ERR: Terminated: ERROR {rc=237} [trial-2357↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21051)] 09:37:58.552500 run osmo-hlr_10.42.42.2(pid=21051): stdout: | (launched: 2022-12-09_09:37:55.369964) 09:37:58.604884 run osmo-hlr_10.42.42.2(pid=21051): stderr: | [0;m[1;31m20221209093755572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093755572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093755572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093755572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093755572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093755572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093755584 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093755595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093755595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093755595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:37:58.677862 run osmo-msc_10.42.42.6(pid=21057): ERR: Terminated: ERROR {rc=2} [trial-2357↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21057)] 09:37:58.728297 run osmo-msc_10.42.42.6(pid=21057): stdout: | (launched: 2022-12-09_09:37:57.494496) 09:37:58.780146 run osmo-msc_10.42.42.6(pid=21057): stderr: | [0;m[38;5;43m20221209093757819 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093757819 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f976172bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093757819 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093757820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093757820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093757820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093757822 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093757822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093757822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093757822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:37:58.832410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21050): Terminating (SIGTERM) 09:37:58.874237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21053): Terminating (SIGTERM) 09:37:58.916302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21056): Terminating (SIGTERM) 09:37:58.958732 --- ParallelTerminationStrategy: PID 21050 died... 09:37:58.978515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21050): Terminated: ok {rc=0} 09:37:59.025024 --- ParallelTerminationStrategy: PID 21053 died... 09:37:59.044660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21053): Terminated: ok {rc=0} 09:37:59.090927 --- ParallelTerminationStrategy: PID 21056 died... 09:37:59.110670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21056): Terminated: ok {rc=0} 09:37:59.199439 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2357 encryption register_a5_3_authreq.py ---------------------------------------------- 09:38:00.354216 tst encryption: Using 1 x ip_address (candidates: 6) 09:38:00.366110 tst encryption: Using 1 x bts (candidates: 1) 09:38:00.403522 tst register_a5_3_authreq.py: using LAC 20569 09:38:00.528443 tst register_a5_3_authreq.py: using RAC 169 09:38:00.654671 tst register_a5_3_authreq.py: using CellId 20569 09:38:00.780603 tst register_a5_3_authreq.py: using BVCI 20570 09:38:00.904499 tst encryption: Using 1 x ip_address (candidates: 6) 09:38:00.916425 tst encryption: Using 1 x ip_address (candidates: 6) 09:38:00.928143 tst encryption: Using 1 x ip_address (candidates: 6) 09:38:00.940727 tst encryption: Using 1 x ip_address (candidates: 6) 09:38:00.952849 tst encryption: Using 1 x ip_address (candidates: 6) 09:38:00.964853 tst encryption: Using 1 x modem (candidates: 1) 09:38:01.101551 tst register_a5_3_authreq.py:8: start network... 09:38:01.336295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:01.914194 run create_hlr_db(pid=21081): Launched 09:38:02.101139 bus /sierra_2: Setting Powered False 09:38:03.199856 run create_hlr_db(pid=21081): Terminated: ok {rc=0} 09:38:03.801988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21322): Launched 09:38:04.196598 run osmo-hlr_10.42.42.2(pid=21332): Launched 09:38:04.441970 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:05.184088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21334): Launched 09:38:05.520657 run osmo-stp_10.42.42.5(pid=21335): Launched 09:38:05.775778 run osmo-msc_10.42.42.6: Starting osmo-msc 09:38:06.471339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21339): Launched 09:38:06.807944 run osmo-msc_10.42.42.6(pid=21340): Launched 09:38:07.167871 run osmo-stp_10.42.42.5(pid=21335): ERR: Terminated: ERROR {rc=1} [trial-2357↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21335)] 09:38:07.448196 run osmo-stp_10.42.42.5(pid=21335): stdout: | (launched: 2022-12-09_09:38:05.461944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:07.745194 run osmo-stp_10.42.42.5(pid=21335): stderr: | [0;m[38;5;43m20221209093805761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093805761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093805762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093805762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093805763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093805763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093805763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:07.894393 run osmo-stp_10.42.42.5(pid=21335): stdout: | (launched: 2022-12-09_09:38:05.461944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:08.024155 run osmo-stp_10.42.42.5(pid=21335): stderr: | [0;m[38;5;43m20221209093805761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209093805761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209093805762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209093805762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209093805763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209093805763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209093805763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:08.178875 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21335): Process ended prematurely: osmo-stp_10.42.42.5(pid=21335) [trial-2357↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21335)] [trial-2357↪encryption↪register_a5_3_authreq.py:8] 09:38:08.188816 tst register_a5_3_authreq.py:8: Test FAILED (7.9 sec) 09:38:08.219119 run osmo-hlr_10.42.42.2(pid=21332): ERR: Terminated: ERROR {rc=237} [trial-2357↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21332)] 09:38:08.270320 run osmo-hlr_10.42.42.2(pid=21332): stdout: | (launched: 2022-12-09_09:38:04.134350) 09:38:08.323013 run osmo-hlr_10.42.42.2(pid=21332): stderr: | [0;m[1;31m20221209093804473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209093804473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209093804473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209093804473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209093804473 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209093804474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209093804495 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209093804508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209093804508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209093804508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:08.395967 run osmo-msc_10.42.42.6(pid=21340): ERR: Terminated: ERROR {rc=2} [trial-2357↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21340)] 09:38:08.446984 run osmo-msc_10.42.42.6(pid=21340): stdout: | (launched: 2022-12-09_09:38:06.748486) 09:38:08.499668 run osmo-msc_10.42.42.6(pid=21340): stderr: | [0;m[38;5;43m20221209093807334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209093807334 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa3c30fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209093807334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209093807335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209093807335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209093807335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209093807343 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209093807344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209093807344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209093807344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:38:08.553055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21322): Terminating (SIGTERM) 09:38:08.596683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21334): Terminating (SIGTERM) 09:38:08.641795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21339): Terminating (SIGTERM) 09:38:08.687152 --- ParallelTerminationStrategy: PID 21322 died... 09:38:08.707548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21322): Terminated: ok {rc=0} 09:38:08.757259 --- ParallelTerminationStrategy: PID 21334 died... 09:38:08.777317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21334): Terminated: ok {rc=0} 09:38:08.825852 --- ParallelTerminationStrategy: PID 21339 died... 09:38:08.845896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21339): Terminated: ok {rc=0} 09:38:08.936774 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 09:38:10.150821 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:10.156399 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 09:38:10.177699 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 09:38:10.209469 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 09:38:10.237067 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 09:38:10.256878 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 09:38:10.287229 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 09:38:10.799416 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 09:38:10.805691 tst handover.py:11: TEST_CONFIG: {} 09:38:11.026686 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:38:11.043811 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:38:11.071154 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:38:11.123920 tst handover.py: using MSISDN 7145 09:38:11.244144 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7145', subscriber_id=0} 09:38:11.360317 run srsepc_10.42.42.118: Starting srsepc 09:38:13.281166 run rm-remote-dir(pid=21345): Launched 09:38:13.474231 bus /sierra_2: Setting Powered False 09:38:14.544208 run rm-remote-dir(pid=21345): Terminated: ok {rc=0} 09:38:15.064424 run mk-remote-dir(pid=21346): Launched 09:38:16.370889 run mk-remote-dir(pid=21346): Terminated: ok {rc=0} 09:38:16.714259 run scp-inst-to-remote(pid=21347): Launched 09:38:18.964714 run scp-inst-to-remote(pid=21347): Terminated: ok {rc=0} 09:38:19.341296 run rm-remote-dir(pid=21349): Launched 09:38:20.607670 run rm-remote-dir(pid=21349): Terminated: ok {rc=0} 09:38:20.988682 run mk-remote-dir(pid=21350): Launched 09:38:22.211288 run mk-remote-dir(pid=21350): Terminated: ok {rc=0} 09:38:22.531810 run scp-cfg-to-remote(pid=21351): Launched 09:38:23.765262 run scp-cfg-to-remote(pid=21351): Terminated: ok {rc=0} 09:38:24.085967 run scp-db-to-remote(pid=21353): Launched 09:38:25.334564 run scp-db-to-remote(pid=21353): Terminated: ok {rc=0} 09:38:25.478719 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:38:25.817387 run patchelf(pid=21355): Launched 09:38:27.008306 run patchelf(pid=21355): Terminated: ok {rc=0} 09:38:27.151758 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:38:27.490498 run setcap-netadm(pid=21356): Launched 09:38:28.680782 run setcap-netadm(pid=21356): Terminated: ok {rc=0} 09:38:29.034137 run srsepc(pid=21357): Launched 09:38:29.160186 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:38:30.364784 run rm-remote-dir(pid=21358): Launched 09:38:30.556624 run srsepc(pid=21357): ERR: Terminated: ERROR {rc=127} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21357)] 09:38:30.703186 run srsepc(pid=21357): stdout: | (launched: 2022-12-09_09:38:28.972379) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:38:30.851475 run srsepc(pid=21357): stderr: | (launched: 2022-12-09_09:38:29.022663) | Connection to 10.42.42.116 closed. 09:38:31.005274 run srsepc(pid=21357): stdout: | (launched: 2022-12-09_09:38:28.972379) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:38:31.150222 run srsepc(pid=21357): stderr: | (launched: 2022-12-09_09:38:29.022663) | Connection to 10.42.42.116 closed. 09:38:31.322153 run rm-remote-dir(pid=21358): Terminating (SIGINT) 09:38:31.520115 run rm-remote-dir(pid=21358): Terminated: ok {rc=0} 09:38:31.662419 tst handover.py:37: ERR: Error: srsepc(pid=21357): Process ended prematurely: srsepc(pid=21357) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21357)] [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 09:38:31.674069 tst handover.py:37: Test FAILED (20.9 sec) 09:38:31.756413 run scp-back-log(pid=21359): Launched 09:38:32.862589 run scp-back-log(pid=21359): ERR: Terminated: ERROR {rc=1} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21359)] 09:38:32.924032 run scp-back-log(pid=21359): stdout: | (launched: 2022-12-09_09:38:31.724233) 09:38:32.987052 run scp-back-log(pid=21359): stderr: | (launched: 2022-12-09_09:38:31.744860) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:38:33.058014 tst srsepc_10.42.42.118: Error('scp-back-log(pid=21359): launch_sync(): local process exited with status 1 [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21359)]') ---------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 09:38:33.103718 tst iperf3_bidir.py:13: Number of physical ue: 1 09:38:33.313344 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:38:33.356667 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 09:38:33.563127 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:38:33.579176 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:38:33.611506 tst iperf3_bidir.py: using MSISDN 7146 09:38:33.734856 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7146', subscriber_id=0} 09:38:33.852577 run srsepc_10.42.42.118: Starting srsepc 09:38:34.538424 run rm-remote-dir(pid=21361): Launched 09:38:35.734618 run rm-remote-dir(pid=21361): Terminated: ok {rc=0} 09:38:36.100460 run mk-remote-dir(pid=21362): Launched 09:38:37.294636 run mk-remote-dir(pid=21362): Terminated: ok {rc=0} 09:38:37.606564 run scp-inst-to-remote(pid=21363): Launched 09:38:39.796335 run scp-inst-to-remote(pid=21363): Terminated: ok {rc=0} 09:38:40.137192 run rm-remote-dir(pid=21365): Launched 09:38:41.321541 run rm-remote-dir(pid=21365): Terminated: ok {rc=0} 09:38:41.664082 run mk-remote-dir(pid=21366): Launched 09:38:42.848291 run mk-remote-dir(pid=21366): Terminated: ok {rc=0} 09:38:43.140147 run scp-cfg-to-remote(pid=21367): Launched 09:38:44.322137 run scp-cfg-to-remote(pid=21367): Terminated: ok {rc=0} 09:38:44.612220 run scp-db-to-remote(pid=21369): Launched 09:38:45.794974 run scp-db-to-remote(pid=21369): Terminated: ok {rc=0} 09:38:45.958862 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:38:46.321751 run patchelf(pid=21371): Launched 09:38:47.537950 run patchelf(pid=21371): Terminated: ok {rc=0} 09:38:47.671442 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:38:47.986535 run setcap-netadm(pid=21372): Launched 09:38:49.168528 run setcap-netadm(pid=21372): Terminated: ok {rc=0} 09:38:49.498517 run srsepc(pid=21373): Launched 09:38:49.617078 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:38:50.749027 run rm-remote-dir(pid=21374): Launched 09:38:50.930273 run srsepc(pid=21373): ERR: Terminated: ERROR {rc=127} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21373)] 09:38:51.068568 run srsepc(pid=21373): stdout: | (launched: 2022-12-09_09:38:49.440447) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:38:51.206228 run srsepc(pid=21373): stderr: | (launched: 2022-12-09_09:38:49.487195) | Connection to 10.42.42.116 closed. 09:38:51.343554 run srsepc(pid=21373): stdout: | (launched: 2022-12-09_09:38:49.440447) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:38:51.475262 run srsepc(pid=21373): stderr: | (launched: 2022-12-09_09:38:49.487195) | Connection to 10.42.42.116 closed. 09:38:51.631478 run rm-remote-dir(pid=21374): Terminating (SIGINT) 09:38:51.811756 run rm-remote-dir(pid=21374): Terminated: ok {rc=0} 09:38:51.942206 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=21373): Process ended prematurely: srsepc(pid=21373) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21373)] [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 09:38:51.952273 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 09:38:52.030595 run scp-back-log(pid=21375): Launched 09:38:53.111021 run scp-back-log(pid=21375): ERR: Terminated: ERROR {rc=1} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21375)] 09:38:53.172302 run scp-back-log(pid=21375): stdout: | (launched: 2022-12-09_09:38:51.999159) 09:38:53.235063 run scp-back-log(pid=21375): stderr: | (launched: 2022-12-09_09:38:52.019096) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:38:53.305775 tst srsepc_10.42.42.118: Error('scp-back-log(pid=21375): launch_sync(): local process exited with status 1 [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21375)]') ---------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 09:38:53.351349 tst iperf3_dl.py:13: Number of physical ue: 1 09:38:53.561393 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:38:53.606423 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 09:38:53.814683 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:38:53.830694 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:38:53.863126 tst iperf3_dl.py: using MSISDN 7147 09:38:53.976829 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7147', subscriber_id=0} 09:38:54.085995 run srsepc_10.42.42.118: Starting srsepc 09:38:54.725648 run rm-remote-dir(pid=21378): Launched 09:38:55.910989 run rm-remote-dir(pid=21378): Terminated: ok {rc=0} 09:38:56.254701 run mk-remote-dir(pid=21379): Launched 09:38:57.437909 run mk-remote-dir(pid=21379): Terminated: ok {rc=0} 09:38:57.731400 run scp-inst-to-remote(pid=21380): Launched 09:38:59.918703 run scp-inst-to-remote(pid=21380): Terminated: ok {rc=0} 09:39:00.283653 run rm-remote-dir(pid=21382): Launched 09:39:01.492833 run rm-remote-dir(pid=21382): Terminated: ok {rc=0} 09:39:01.878108 run mk-remote-dir(pid=21383): Launched 09:39:03.142625 run mk-remote-dir(pid=21383): Terminated: ok {rc=0} 09:39:03.455169 run scp-cfg-to-remote(pid=21384): Launched 09:39:04.648724 run scp-cfg-to-remote(pid=21384): Terminated: ok {rc=0} 09:39:04.962951 run scp-db-to-remote(pid=21386): Launched 09:39:06.156710 run scp-db-to-remote(pid=21386): Terminated: ok {rc=0} 09:39:06.300308 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:39:06.638380 run patchelf(pid=21388): Launched 09:39:07.831049 run patchelf(pid=21388): Terminated: ok {rc=0} 09:39:07.974263 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:39:08.310805 run setcap-netadm(pid=21389): Launched 09:39:09.502874 run setcap-netadm(pid=21389): Terminated: ok {rc=0} 09:39:09.855307 run srsepc(pid=21390): Launched 09:39:09.982173 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:39:11.192470 run rm-remote-dir(pid=21391): Launched 09:39:11.383441 run srsepc(pid=21390): ERR: Terminated: ERROR {rc=127} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21390)] 09:39:11.529393 run srsepc(pid=21390): stdout: | (launched: 2022-12-09_09:39:09.794043) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:39:11.683073 run srsepc(pid=21390): stderr: | (launched: 2022-12-09_09:39:09.843980) | Connection to 10.42.42.116 closed. 09:39:11.825860 run srsepc(pid=21390): stdout: | (launched: 2022-12-09_09:39:09.794043) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:39:11.963234 run srsepc(pid=21390): stderr: | (launched: 2022-12-09_09:39:09.843980) | Connection to 10.42.42.116 closed. 09:39:12.126033 run rm-remote-dir(pid=21391): Terminating (SIGINT) 09:39:12.313616 run rm-remote-dir(pid=21391): Terminated: ok {rc=0} 09:39:12.449476 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=21390): Process ended prematurely: srsepc(pid=21390) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21390)] [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 09:39:12.460435 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 09:39:12.541256 run scp-back-log(pid=21392): Launched 09:39:13.620333 run scp-back-log(pid=21392): ERR: Terminated: ERROR {rc=1} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21392)] 09:39:13.683494 run scp-back-log(pid=21392): stdout: | (launched: 2022-12-09_09:39:12.509274) 09:39:13.748338 run scp-back-log(pid=21392): stderr: | (launched: 2022-12-09_09:39:12.529816) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:39:13.821499 tst srsepc_10.42.42.118: Error('scp-back-log(pid=21392): launch_sync(): local process exited with status 1 [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21392)]') ---------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 09:39:13.868682 tst iperf3_ul.py:13: Number of physical ue: 1 09:39:14.089352 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:39:14.135456 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 09:39:14.337473 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:39:14.353581 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:39:14.384376 tst iperf3_ul.py: using MSISDN 7148 09:39:14.496932 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7148', subscriber_id=0} 09:39:14.603410 run srsepc_10.42.42.118: Starting srsepc 09:39:15.230058 run rm-remote-dir(pid=21394): Launched 09:39:16.412485 run rm-remote-dir(pid=21394): Terminated: ok {rc=0} 09:39:16.760426 run mk-remote-dir(pid=21395): Launched 09:39:17.981838 run mk-remote-dir(pid=21395): Terminated: ok {rc=0} 09:39:18.287302 run scp-inst-to-remote(pid=21396): Launched 09:39:20.476089 run scp-inst-to-remote(pid=21396): Terminated: ok {rc=0} 09:39:20.832487 run rm-remote-dir(pid=21398): Launched 09:39:22.022184 run rm-remote-dir(pid=21398): Terminated: ok {rc=0} 09:39:22.377482 run mk-remote-dir(pid=21399): Launched 09:39:23.567070 run mk-remote-dir(pid=21399): Terminated: ok {rc=0} 09:39:23.869425 run scp-cfg-to-remote(pid=21400): Launched 09:39:25.054244 run scp-cfg-to-remote(pid=21400): Terminated: ok {rc=0} 09:39:25.354652 run scp-db-to-remote(pid=21402): Launched 09:39:26.544057 run scp-db-to-remote(pid=21402): Terminated: ok {rc=0} 09:39:26.683191 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:39:27.010444 run patchelf(pid=21404): Launched 09:39:28.196460 run patchelf(pid=21404): Terminated: ok {rc=0} 09:39:28.335463 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:39:28.663588 run setcap-netadm(pid=21405): Launched 09:39:29.848907 run setcap-netadm(pid=21405): Terminated: ok {rc=0} 09:39:30.191253 run srsepc(pid=21406): Launched 09:39:30.312507 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:39:31.524335 run rm-remote-dir(pid=21407): Launched 09:39:31.823194 run srsepc(pid=21406): ERR: Terminated: ERROR {rc=127} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21406)] 09:39:31.970024 run srsepc(pid=21406): stdout: | (launched: 2022-12-09_09:39:30.131919) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:39:32.118725 run srsepc(pid=21406): stderr: | (launched: 2022-12-09_09:39:30.180378) | Connection to 10.42.42.116 closed. 09:39:32.267221 run srsepc(pid=21406): stdout: | (launched: 2022-12-09_09:39:30.131919) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:39:32.405668 run srsepc(pid=21406): stderr: | (launched: 2022-12-09_09:39:30.180378) | Connection to 10.42.42.116 closed. 09:39:32.569810 run rm-remote-dir(pid=21407): Terminating (SIGINT) 09:39:32.758213 run rm-remote-dir(pid=21407): Terminated: ok {rc=0} 09:39:32.894582 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=21406): Process ended prematurely: srsepc(pid=21406) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21406)] [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 09:39:32.905506 tst iperf3_ul.py:42: Test FAILED (19.0 sec) 09:39:32.986464 run scp-back-log(pid=21408): Launched 09:39:34.067157 run scp-back-log(pid=21408): ERR: Terminated: ERROR {rc=1} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21408)] 09:39:34.131044 run scp-back-log(pid=21408): stdout: | (launched: 2022-12-09_09:39:32.954790) 09:39:34.196131 run scp-back-log(pid=21408): stderr: | (launched: 2022-12-09_09:39:32.975498) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:39:34.269696 tst srsepc_10.42.42.118: Error('scp-back-log(pid=21408): launch_sync(): local process exited with status 1 [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21408)]') ---------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 09:39:34.318221 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:39:34.335605 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:39:34.360439 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:39:34.411567 tst ping.py: using MSISDN 7149 09:39:34.535008 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7149', subscriber_id=0} 09:39:34.649619 run srsepc_10.42.42.118: Starting srsepc 09:39:35.317648 run rm-remote-dir(pid=21410): Launched 09:39:36.506437 run rm-remote-dir(pid=21410): Terminated: ok {rc=0} 09:39:36.861245 run mk-remote-dir(pid=21411): Launched 09:39:38.049365 run mk-remote-dir(pid=21411): Terminated: ok {rc=0} 09:39:38.351555 run scp-inst-to-remote(pid=21412): Launched 09:39:40.536710 run scp-inst-to-remote(pid=21412): Terminated: ok {rc=0} 09:39:40.867785 run rm-remote-dir(pid=21414): Launched 09:39:42.046249 run rm-remote-dir(pid=21414): Terminated: ok {rc=0} 09:39:42.385074 run mk-remote-dir(pid=21415): Launched 09:39:43.570532 run mk-remote-dir(pid=21415): Terminated: ok {rc=0} 09:39:43.870839 run scp-cfg-to-remote(pid=21416): Launched 09:39:45.055619 run scp-cfg-to-remote(pid=21416): Terminated: ok {rc=0} 09:39:45.355140 run scp-db-to-remote(pid=21418): Launched 09:39:46.539623 run scp-db-to-remote(pid=21418): Terminated: ok {rc=0} 09:39:46.674061 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:39:46.993534 run patchelf(pid=21420): Launched 09:39:48.219791 run patchelf(pid=21420): Terminated: ok {rc=0} 09:39:48.358015 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:39:48.682788 run setcap-netadm(pid=21421): Launched 09:39:49.869193 run setcap-netadm(pid=21421): Terminated: ok {rc=0} 09:39:50.209294 run srsepc(pid=21422): Launched 09:39:50.330334 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:39:51.437902 run rm-remote-dir(pid=21423): Launched 09:39:51.612827 run srsepc(pid=21422): ERR: Terminated: ERROR {rc=127} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21422)] 09:39:51.747117 run srsepc(pid=21422): stdout: | (launched: 2022-12-09_09:39:50.150377) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:39:51.880801 run srsepc(pid=21422): stderr: | (launched: 2022-12-09_09:39:50.198840) | Connection to 10.42.42.116 closed. 09:39:52.014073 run srsepc(pid=21422): stdout: | (launched: 2022-12-09_09:39:50.150377) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:39:52.141816 run srsepc(pid=21422): stderr: | (launched: 2022-12-09_09:39:50.198840) | Connection to 10.42.42.116 closed. 09:39:52.293256 run rm-remote-dir(pid=21423): Terminating (SIGINT) 09:39:52.468203 run rm-remote-dir(pid=21423): Terminated: ok {rc=0} 09:39:52.595247 tst ping.py:16: ERR: Error: srsepc(pid=21422): Process ended prematurely: srsepc(pid=21422) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21422)] [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 09:39:52.605117 tst ping.py:16: Test FAILED (18.3 sec) 09:39:52.681194 run scp-back-log(pid=21424): Launched 09:39:53.757540 run scp-back-log(pid=21424): ERR: Terminated: ERROR {rc=1} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21424)] 09:39:53.817690 run scp-back-log(pid=21424): stdout: | (launched: 2022-12-09_09:39:52.651203) 09:39:53.878904 run scp-back-log(pid=21424): stderr: | (launched: 2022-12-09_09:39:52.670933) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:39:53.947878 tst srsepc_10.42.42.118: Error('scp-back-log(pid=21424): launch_sync(): local process exited with status 1 [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21424)]') ---------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 09:39:53.992768 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:39:54.009349 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:39:54.032013 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:39:54.081934 tst rrc_idle_mo_ping.py: using MSISDN 7150 09:39:54.195765 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7150', subscriber_id=0} 09:39:54.301110 run srsepc_10.42.42.118: Starting srsepc 09:39:54.916420 run rm-remote-dir(pid=21426): Launched 09:39:56.094372 run rm-remote-dir(pid=21426): Terminated: ok {rc=0} 09:39:56.424483 run mk-remote-dir(pid=21427): Launched 09:39:57.601655 run mk-remote-dir(pid=21427): Terminated: ok {rc=0} 09:39:57.882879 run scp-inst-to-remote(pid=21428): Launched 09:40:00.060660 run scp-inst-to-remote(pid=21428): Terminated: ok {rc=0} 09:40:00.389983 run rm-remote-dir(pid=21430): Launched 09:40:01.582831 run rm-remote-dir(pid=21430): Terminated: ok {rc=0} 09:40:01.992153 run mk-remote-dir(pid=21434): Launched 09:40:03.263197 run mk-remote-dir(pid=21434): Terminated: ok {rc=0} 09:40:03.564645 run scp-cfg-to-remote(pid=21435): Launched 09:40:04.750133 run scp-cfg-to-remote(pid=21435): Terminated: ok {rc=0} 09:40:05.048143 run scp-db-to-remote(pid=21437): Launched 09:40:06.235537 run scp-db-to-remote(pid=21437): Terminated: ok {rc=0} 09:40:06.373579 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:40:06.698371 run patchelf(pid=21439): Launched 09:40:07.882637 run patchelf(pid=21439): Terminated: ok {rc=0} 09:40:08.020599 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:40:08.345597 run setcap-netadm(pid=21440): Launched 09:40:09.529573 run setcap-netadm(pid=21440): Terminated: ok {rc=0} 09:40:09.869288 run srsepc(pid=21441): Launched 09:40:09.989254 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:40:11.101637 run rm-remote-dir(pid=21442): Launched 09:40:11.277596 run srsepc(pid=21441): ERR: Terminated: ERROR {rc=127} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21441)] 09:40:11.411448 run srsepc(pid=21441): stdout: | (launched: 2022-12-09_09:40:09.810939) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:40:11.545240 run srsepc(pid=21441): stderr: | (launched: 2022-12-09_09:40:09.859079) | Connection to 10.42.42.116 closed. 09:40:11.678365 run srsepc(pid=21441): stdout: | (launched: 2022-12-09_09:40:09.810939) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:40:11.805916 run srsepc(pid=21441): stderr: | (launched: 2022-12-09_09:40:09.859079) | Connection to 10.42.42.116 closed. 09:40:11.957088 run rm-remote-dir(pid=21442): Terminating (SIGINT) 09:40:12.132510 run rm-remote-dir(pid=21442): Terminated: ok {rc=0} 09:40:12.259278 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=21441): Process ended prematurely: srsepc(pid=21441) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21441)] [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 09:40:12.269092 tst rrc_idle_mo_ping.py:16: Test FAILED (18.3 sec) 09:40:12.345739 run scp-back-log(pid=21443): Launched 09:40:13.422180 run scp-back-log(pid=21443): ERR: Terminated: ERROR {rc=1} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21443)] 09:40:13.482397 run scp-back-log(pid=21443): stdout: | (launched: 2022-12-09_09:40:12.315537) 09:40:13.544180 run scp-back-log(pid=21443): stderr: | (launched: 2022-12-09_09:40:12.335404) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:40:13.613625 tst srsepc_10.42.42.118: Error('scp-back-log(pid=21443): launch_sync(): local process exited with status 1 [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21443)]') ---------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 09:40:13.658748 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:40:13.675398 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:40:13.698177 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:40:13.748057 tst rrc_idle_mt_ping.py: using MSISDN 7151 09:40:13.861188 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7151', subscriber_id=0} 09:40:13.966958 run srsepc_10.42.42.118: Starting srsepc 09:40:14.584174 run rm-remote-dir(pid=21445): Launched 09:40:15.761935 run rm-remote-dir(pid=21445): Terminated: ok {rc=0} 09:40:16.167615 run mk-remote-dir(pid=21446): Launched 09:40:17.476652 run mk-remote-dir(pid=21446): Terminated: ok {rc=0} 09:40:17.758815 run scp-inst-to-remote(pid=21447): Launched 09:40:19.936484 run scp-inst-to-remote(pid=21447): Terminated: ok {rc=0} 09:40:20.265158 run rm-remote-dir(pid=21449): Launched 09:40:21.442154 run rm-remote-dir(pid=21449): Terminated: ok {rc=0} 09:40:21.772475 run mk-remote-dir(pid=21450): Launched 09:40:22.950512 run mk-remote-dir(pid=21450): Terminated: ok {rc=0} 09:40:23.232092 run scp-cfg-to-remote(pid=21451): Launched 09:40:24.406566 run scp-cfg-to-remote(pid=21451): Terminated: ok {rc=0} 09:40:24.686414 run scp-db-to-remote(pid=21453): Launched 09:40:25.862194 run scp-db-to-remote(pid=21453): Terminated: ok {rc=0} 09:40:25.991334 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:40:26.295595 run patchelf(pid=21455): Launched 09:40:27.470635 run patchelf(pid=21455): Terminated: ok {rc=0} 09:40:27.600658 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:40:27.905587 run setcap-netadm(pid=21456): Launched 09:40:29.091632 run setcap-netadm(pid=21456): Terminated: ok {rc=0} 09:40:29.432931 run srsepc(pid=21457): Launched 09:40:29.554728 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:40:30.658207 run rm-remote-dir(pid=21458): Launched 09:40:30.850910 run srsepc(pid=21457): ERR: Terminated: ERROR {rc=127} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21457)] 09:40:31.048902 run srsepc(pid=21457): stdout: | (launched: 2022-12-09_09:40:29.374179) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:40:31.183665 run srsepc(pid=21457): stderr: | (launched: 2022-12-09_09:40:29.422469) | Connection to 10.42.42.116 closed. 09:40:31.319223 run srsepc(pid=21457): stdout: | (launched: 2022-12-09_09:40:29.374179) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:40:31.449370 run srsepc(pid=21457): stderr: | (launched: 2022-12-09_09:40:29.422469) | Connection to 10.42.42.116 closed. 09:40:31.603859 run rm-remote-dir(pid=21458): Terminating (SIGINT) 09:40:31.780832 run rm-remote-dir(pid=21458): Terminated: ok {rc=0} 09:40:31.909262 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=21457): Process ended prematurely: srsepc(pid=21457) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21457)] [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 09:40:31.919730 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 09:40:32.004665 run scp-back-log(pid=21459): Launched 09:40:33.119124 run scp-back-log(pid=21459): ERR: Terminated: ERROR {rc=1} [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21459)] 09:40:33.179079 run scp-back-log(pid=21459): stdout: | (launched: 2022-12-09_09:40:31.966629) 09:40:33.240925 run scp-back-log(pid=21459): stderr: | (launched: 2022-12-09_09:40:31.986505) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:40:33.310180 tst srsepc_10.42.42.118: Error('scp-back-log(pid=21459): launch_sync(): local process exited with status 1 [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=21459)]') --------------------------------------------------------------------- trial-2357 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 09:40:33.438143 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:33.442916 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 09:40:33.483890 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 09:40:33.510501 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 09:40:33.564194 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 09:40:33.608799 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 09:40:33.636819 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 09:40:34.185615 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 09:40:34.191145 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:40:34.202587 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:40:34.241925 tst handover.py: using LAC 20570 09:40:34.369744 tst handover.py: using RAC 170 09:40:34.496387 tst handover.py: using CellId 20570 09:40:34.624319 tst handover.py: using BVCI 20571 09:40:34.740428 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:40:34.777365 tst handover.py: using LAC 20571 09:40:34.902629 tst handover.py: using RAC 171 09:40:35.029334 tst handover.py: using CellId 20571 09:40:35.154565 tst handover.py: using BVCI 20572 09:40:35.271003 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:40:35.282393 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:40:35.293594 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:40:35.304883 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:40:35.316706 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:40:35.328161 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:40:35.444151 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:40:35.562928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:36.057660 run create_hlr_db(pid=21466): Launched 09:40:37.244760 run create_hlr_db(pid=21466): Terminated: ok {rc=0} 09:40:37.581664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Launched 09:40:37.899800 run osmo-hlr_10.42.42.2(pid=21469): Launched 09:40:38.021400 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:38.573608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Launched 09:40:38.891197 run osmo-stp_10.42.42.5(pid=21472): Launched 09:40:39.013032 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:39.588326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21474): Launched 09:40:39.905663 run osmo-msc_10.42.42.6(pid=21475): Launched 09:40:40.083272 run osmo-stp_10.42.42.5(pid=21472): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] 09:40:40.219482 run osmo-stp_10.42.42.5(pid=21472): stdout: | (launched: 2022-12-09_09:40:38.833754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:40.355778 run osmo-stp_10.42.42.5(pid=21472): stderr: | [0;m[38;5;43m20221209094039019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094039019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094039020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094039020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094039021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094039021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094039021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:40.489307 run osmo-stp_10.42.42.5(pid=21472): stdout: | (launched: 2022-12-09_09:40:38.833754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:40.616575 run osmo-stp_10.42.42.5(pid=21472): stderr: | [0;m[38;5;43m20221209094039019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094039019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094039020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094039020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094039021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094039021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094039021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:40.768442 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21472): Process ended prematurely: osmo-stp_10.42.42.5(pid=21472) [trial-2357↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] [trial-2357↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 09:40:40.777347 tst handover.py:18: Test FAILED (6.6 sec) 09:40:40.804798 run osmo-hlr_10.42.42.2(pid=21469): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21469)] 09:40:40.854516 run osmo-hlr_10.42.42.2(pid=21469): stdout: | (launched: 2022-12-09_09:40:37.842401) 09:40:40.905859 run osmo-hlr_10.42.42.2(pid=21469): stderr: | [0;m[1;31m20221209094038035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094038035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094038035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094038035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094038035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094038035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094038048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094038056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094038056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094038056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:40.977778 run osmo-msc_10.42.42.6(pid=21475): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21475)] 09:40:41.027452 run osmo-msc_10.42.42.6(pid=21475): stdout: | (launched: 2022-12-09_09:40:39.848179) 09:40:41.078642 run osmo-msc_10.42.42.6(pid=21475): stderr: | [0;m[38;5;43m20221209094040162 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094040162 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f53f1ff0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094040162 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094040163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094040163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094040163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094040165 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094040165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094040165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094040165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:41.130393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Terminating (SIGTERM) 09:40:41.172144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Terminating (SIGTERM) 09:40:41.213694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21474): Terminating (SIGTERM) 09:40:41.255431 --- ParallelTerminationStrategy: PID 21468 died... 09:40:41.275104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Terminated: ok {rc=0} 09:40:41.321358 --- ParallelTerminationStrategy: PID 21471 died... 09:40:41.340472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Terminated: ok {rc=0} 09:40:41.386008 --- ParallelTerminationStrategy: PID 21474 died... 09:40:41.405268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21474): Terminated: ok {rc=0} 09:40:41.491617 bus /sierra_3: Setting Powered False 09:40:42.587307 bus /sierra_3: Setting Powered False 09:40:43.701962 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 09:40:44.950785 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:44.956152 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:40:44.998014 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:40:45.026050 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:40:45.079108 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:40:45.120397 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:40:45.147986 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:40:45.700230 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 09:40:45.706567 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:40:45.718616 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:40:45.758576 tst handover.py: using LAC 20572 09:40:45.911314 tst handover.py: using RAC 172 09:40:46.039251 tst handover.py: using CellId 20572 09:40:46.196875 tst handover.py: using BVCI 20573 09:40:46.306706 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:40:46.342288 tst handover.py: using LAC 20573 09:40:46.470220 tst handover.py: using RAC 173 09:40:46.612612 tst handover.py: using CellId 20573 09:40:46.730689 tst handover.py: using BVCI 20574 09:40:46.871710 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:40:46.884166 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:40:46.897749 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:40:46.912281 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:40:46.926062 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:40:46.939966 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:40:47.065770 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:40:47.217338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:47.697611 run create_hlr_db(pid=21481): Launched 09:40:47.826991 bus /sierra_2: Setting Powered False 09:40:48.890099 run create_hlr_db(pid=21481): Terminated: ok {rc=0} 09:40:49.304877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21483): Launched 09:40:49.624126 run osmo-hlr_10.42.42.2(pid=21484): Launched 09:40:49.746490 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:50.266926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21486): Launched 09:40:50.585878 run osmo-stp_10.42.42.5(pid=21487): Launched 09:40:50.707257 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:51.256304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21489): Launched 09:40:51.577362 run osmo-msc_10.42.42.6(pid=21490): Launched 09:40:51.755933 run osmo-stp_10.42.42.5(pid=21487): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21487)] 09:40:51.891854 run osmo-stp_10.42.42.5(pid=21487): stdout: | (launched: 2022-12-09_09:40:50.527859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:52.028073 run osmo-stp_10.42.42.5(pid=21487): stderr: | [0;m[38;5;43m20221209094050715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094050715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094050715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094050716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094050716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094050716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094050716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:52.162188 run osmo-stp_10.42.42.5(pid=21487): stdout: | (launched: 2022-12-09_09:40:50.527859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:52.289455 run osmo-stp_10.42.42.5(pid=21487): stderr: | [0;m[38;5;43m20221209094050715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094050715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094050715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094050716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094050716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094050716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094050716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:52.441936 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21487): Process ended prematurely: osmo-stp_10.42.42.5(pid=21487) [trial-2357↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21487)] [trial-2357↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 09:40:52.450833 tst handover.py:18: Test FAILED (6.7 sec) 09:40:52.478201 run osmo-hlr_10.42.42.2(pid=21484): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21484)] 09:40:52.528063 run osmo-hlr_10.42.42.2(pid=21484): stdout: | (launched: 2022-12-09_09:40:49.566267) 09:40:52.579192 run osmo-hlr_10.42.42.2(pid=21484): stderr: | [0;m[1;31m20221209094049762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094049762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094049762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094049762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094049762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094049762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094049774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094049784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094049785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094049785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:52.650574 run osmo-msc_10.42.42.6(pid=21490): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21490)] 09:40:52.700030 run osmo-msc_10.42.42.6(pid=21490): stdout: | (launched: 2022-12-09_09:40:51.519028) 09:40:52.751139 run osmo-msc_10.42.42.6(pid=21490): stderr: | [0;m[38;5;43m20221209094051835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094051835 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efc6042fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094051835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094051835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094051836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094051836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094051837 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094051838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094051838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094051838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:52.802587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21483): Terminating (SIGTERM) 09:40:52.843897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21486): Terminating (SIGTERM) 09:40:52.885315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21489): Terminating (SIGTERM) 09:40:52.927270 --- ParallelTerminationStrategy: PID 21483 died... 09:40:52.946959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21483): Terminated: ok {rc=0} 09:40:52.993207 --- ParallelTerminationStrategy: PID 21486 died... 09:40:53.012449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21486): Terminated: ok {rc=0} 09:40:53.058370 --- ParallelTerminationStrategy: PID 21489 died... 09:40:53.077643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21489): Terminated: ok {rc=0} 09:40:53.164319 bus /sierra_3: Setting Powered False 09:40:54.262847 bus /sierra_3: Setting Powered False 09:40:55.379222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 09:40:56.630434 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:56.635805 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:40:56.691806 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:40:56.719447 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:40:56.772537 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:40:56.827667 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:40:56.855277 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:40:57.409976 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 09:40:57.416241 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:40:57.428128 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:40:57.464824 tst handover.py: using LAC 20574 09:40:57.583462 tst handover.py: using RAC 174 09:40:57.702495 tst handover.py: using CellId 20574 09:40:57.824468 tst handover.py: using BVCI 20575 09:40:57.934289 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:40:57.980694 tst handover.py: using LAC 20575 09:40:58.095820 tst handover.py: using RAC 175 09:40:58.211317 tst handover.py: using CellId 20575 09:40:58.326319 tst handover.py: using BVCI 20576 09:40:58.434579 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:40:58.445503 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:40:58.456092 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:40:58.466757 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:40:58.477470 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:40:58.488043 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:40:58.606601 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:40:58.724754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:59.191294 run create_hlr_db(pid=21495): Launched 09:40:59.321189 bus /sierra_2: Setting Powered False 09:41:00.384232 run create_hlr_db(pid=21495): Terminated: ok {rc=0} 09:41:00.786253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21497): Launched 09:41:01.107016 run osmo-hlr_10.42.42.2(pid=21498): Launched 09:41:01.328282 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:02.218446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21500): Launched 09:41:02.533058 run osmo-stp_10.42.42.5(pid=21501): Launched 09:41:02.646832 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:03.162692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21503): Launched 09:41:03.461591 run osmo-msc_10.42.42.6(pid=21504): Launched 09:41:03.628273 run osmo-stp_10.42.42.5(pid=21501): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21501)] 09:41:03.755830 run osmo-stp_10.42.42.5(pid=21501): stdout: | (launched: 2022-12-09_09:41:02.478395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:03.882540 run osmo-stp_10.42.42.5(pid=21501): stderr: | [0;m[38;5;43m20221209094102642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094102643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094102643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094102643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094102644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094102644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094102644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:04.007026 run osmo-stp_10.42.42.5(pid=21501): stdout: | (launched: 2022-12-09_09:41:02.478395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:04.126018 run osmo-stp_10.42.42.5(pid=21501): stderr: | [0;m[38;5;43m20221209094102642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094102643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094102643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094102643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094102644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094102644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094102644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:04.268274 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21501): Process ended prematurely: osmo-stp_10.42.42.5(pid=21501) [trial-2357↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21501)] [trial-2357↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 09:41:04.276278 tst handover.py:18: Test FAILED (6.9 sec) 09:41:04.302053 run osmo-hlr_10.42.42.2(pid=21498): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21498)] 09:41:04.349410 run osmo-hlr_10.42.42.2(pid=21498): stdout: | (launched: 2022-12-09_09:41:01.045434) 09:41:04.398344 run osmo-hlr_10.42.42.2(pid=21498): stderr: | [0;m[1;31m20221209094101372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094101372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094101373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094101373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094101373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094101373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094101394 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094101404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094101404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094101404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:04.466901 run osmo-msc_10.42.42.6(pid=21504): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21504)] 09:41:04.514352 run osmo-msc_10.42.42.6(pid=21504): stdout: | (launched: 2022-12-09_09:41:03.406823) 09:41:04.563161 run osmo-msc_10.42.42.6(pid=21504): stderr: | [0;m[38;5;43m20221209094103677 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094103678 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ca958ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094103678 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094103678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094103678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094103678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094103680 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094103680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094103680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094103680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:04.612358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21497): Terminating (SIGTERM) 09:41:04.651768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21500): Terminating (SIGTERM) 09:41:04.691114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21503): Terminating (SIGTERM) 09:41:04.730650 --- ParallelTerminationStrategy: PID 21497 died... 09:41:04.749451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21497): Terminated: ok {rc=0} 09:41:04.792605 --- ParallelTerminationStrategy: PID 21500 died... 09:41:04.810949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21500): Terminated: ok {rc=0} 09:41:04.853959 --- ParallelTerminationStrategy: PID 21503 died... 09:41:04.872357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21503): Terminated: ok {rc=0} 09:41:04.956353 bus /sierra_3: Setting Powered False 09:41:06.055714 bus /sierra_3: Setting Powered False 09:41:07.168459 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:41:08.428197 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:08.433064 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:41:08.482543 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:41:08.508935 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:41:08.561315 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:41:08.611553 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:41:08.638084 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:41:09.190840 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:41:09.195870 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:09.207001 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:41:09.243753 tst handover.py: using LAC 20576 09:41:09.361131 tst handover.py: using RAC 176 09:41:09.478864 tst handover.py: using CellId 20576 09:41:09.595426 tst handover.py: using BVCI 20577 09:41:09.713336 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:41:09.760389 tst handover.py: using LAC 20577 09:41:09.888111 tst handover.py: using RAC 177 09:41:10.014743 tst handover.py: using CellId 20577 09:41:10.141829 tst handover.py: using BVCI 20578 09:41:10.259282 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:10.271042 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:10.282462 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:10.294690 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:10.306765 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:10.318964 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:41:10.436346 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:41:10.558231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:11.027395 run create_hlr_db(pid=21516): Launched 09:41:11.157381 bus /sierra_2: Setting Powered False 09:41:12.221501 run create_hlr_db(pid=21516): Terminated: ok {rc=0} 09:41:12.624688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21518): Launched 09:41:12.925207 run osmo-hlr_10.42.42.2(pid=21519): Launched 09:41:13.049849 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:13.573209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21521): Launched 09:41:13.892730 run osmo-stp_10.42.42.5(pid=21522): Launched 09:41:14.014045 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:14.566563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21524): Launched 09:41:14.886782 run osmo-msc_10.42.42.6(pid=21525): Launched 09:41:15.065676 run osmo-stp_10.42.42.5(pid=21522): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21522)] 09:41:15.201159 run osmo-stp_10.42.42.5(pid=21522): stdout: | (launched: 2022-12-09_09:41:13.834751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:15.336718 run osmo-stp_10.42.42.5(pid=21522): stderr: | [0;m[38;5;43m20221209094114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094114022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:15.470871 run osmo-stp_10.42.42.5(pid=21522): stdout: | (launched: 2022-12-09_09:41:13.834751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:15.599206 run osmo-stp_10.42.42.5(pid=21522): stderr: | [0;m[38;5;43m20221209094114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094114022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:15.751911 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21522): Process ended prematurely: osmo-stp_10.42.42.5(pid=21522) [trial-2357↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21522)] [trial-2357↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 09:41:15.760780 tst handover.py:18: Test FAILED (6.6 sec) 09:41:15.788278 run osmo-hlr_10.42.42.2(pid=21519): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21519)] 09:41:15.839694 run osmo-hlr_10.42.42.2(pid=21519): stdout: | (launched: 2022-12-09_09:41:12.869738) 09:41:15.903262 run osmo-hlr_10.42.42.2(pid=21519): stderr: | [0;m[1;31m20221209094113057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094113057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094113057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094113057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094113057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094113057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094113096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094113106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094113106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094113106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:15.978346 run osmo-msc_10.42.42.6(pid=21525): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21525)] 09:41:16.029706 run osmo-msc_10.42.42.6(pid=21525): stdout: | (launched: 2022-12-09_09:41:14.828655) 09:41:16.082201 run osmo-msc_10.42.42.6(pid=21525): stderr: | [0;m[38;5;43m20221209094115146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094115146 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78e436ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094115146 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094115146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094115146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094115147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094115148 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094115149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094115149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094115149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:16.134887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21518): Terminating (SIGTERM) 09:41:16.177750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21521): Terminating (SIGTERM) 09:41:16.222144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21524): Terminating (SIGTERM) 09:41:16.266595 --- ParallelTerminationStrategy: PID 21518 died... 09:41:16.286488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21518): Terminated: ok {rc=0} 09:41:16.333635 --- ParallelTerminationStrategy: PID 21521 died... 09:41:16.353577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21521): Terminated: ok {rc=0} 09:41:16.400527 --- ParallelTerminationStrategy: PID 21524 died... 09:41:16.420638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21524): Terminated: ok {rc=0} 09:41:16.509325 bus /sierra_3: Setting Powered False 09:41:17.608716 bus /sierra_3: Setting Powered False 09:41:18.724150 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:41:19.981829 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:19.986887 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:41:20.041270 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:41:20.068162 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:41:20.123967 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:41:20.177963 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:41:20.204362 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:41:20.757683 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:41:20.763692 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:20.775747 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:41:20.827345 tst handover.py: using LAC 20578 09:41:20.945344 tst handover.py: using RAC 178 09:41:21.060646 tst handover.py: using CellId 20578 09:41:21.176506 tst handover.py: using BVCI 20579 09:41:21.283942 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:41:21.331921 tst handover.py: using LAC 20579 09:41:21.447220 tst handover.py: using RAC 179 09:41:21.562883 tst handover.py: using CellId 20579 09:41:21.680203 tst handover.py: using BVCI 20580 09:41:21.787900 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:21.798986 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:21.809879 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:21.820801 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:21.831748 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:21.842971 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:41:21.956194 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:41:22.074971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:22.517155 run create_hlr_db(pid=21530): Launched 09:41:22.640707 bus /sierra_2: Setting Powered False 09:41:23.701044 run create_hlr_db(pid=21530): Terminated: ok {rc=0} 09:41:24.109243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21532): Launched 09:41:24.428166 run osmo-hlr_10.42.42.2(pid=21533): Launched 09:41:24.551312 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:25.082138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21535): Launched 09:41:25.400884 run osmo-stp_10.42.42.5(pid=21536): Launched 09:41:25.522953 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:26.074263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21538): Launched 09:41:26.392838 run osmo-msc_10.42.42.6(pid=21539): Launched 09:41:26.571532 run osmo-stp_10.42.42.5(pid=21536): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21536)] 09:41:26.707559 run osmo-stp_10.42.42.5(pid=21536): stdout: | (launched: 2022-12-09_09:41:25.342864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:26.843617 run osmo-stp_10.42.42.5(pid=21536): stderr: | [0;m[38;5;43m20221209094125530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094125530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094125530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094125531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094125531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094125531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094125531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:26.977179 run osmo-stp_10.42.42.5(pid=21536): stdout: | (launched: 2022-12-09_09:41:25.342864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:27.104202 run osmo-stp_10.42.42.5(pid=21536): stderr: | [0;m[38;5;43m20221209094125530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094125530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094125530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094125531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094125531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094125531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094125531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:27.256126 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21536): Process ended prematurely: osmo-stp_10.42.42.5(pid=21536) [trial-2357↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21536)] [trial-2357↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 09:41:27.264909 tst handover.py:18: Test FAILED (6.5 sec) 09:41:27.292563 run osmo-hlr_10.42.42.2(pid=21533): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21533)] 09:41:27.342735 run osmo-hlr_10.42.42.2(pid=21533): stdout: | (launched: 2022-12-09_09:41:24.370425) 09:41:27.394589 run osmo-hlr_10.42.42.2(pid=21533): stderr: | [0;m[1;31m20221209094124565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094124565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094124565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094124565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094124565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094124565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094124578 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094124586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094124586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094124586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:27.466836 run osmo-msc_10.42.42.6(pid=21539): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21539)] 09:41:27.516879 run osmo-msc_10.42.42.6(pid=21539): stdout: | (launched: 2022-12-09_09:41:26.334947) 09:41:27.568935 run osmo-msc_10.42.42.6(pid=21539): stderr: | [0;m[38;5;43m20221209094126651 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094126651 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b08262c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094126652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094126652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094126652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094126652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094126654 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094126654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094126654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094126654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:27.621266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21532): Terminating (SIGTERM) 09:41:27.663367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21535): Terminating (SIGTERM) 09:41:27.705277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21538): Terminating (SIGTERM) 09:41:27.747164 --- ParallelTerminationStrategy: PID 21532 died... 09:41:27.767231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21532): Terminated: ok {rc=0} 09:41:27.813619 --- ParallelTerminationStrategy: PID 21535 died... 09:41:27.832935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21535): Terminated: ok {rc=0} 09:41:27.879249 --- ParallelTerminationStrategy: PID 21538 died... 09:41:27.898654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21538): Terminated: ok {rc=0} 09:41:27.987057 bus /sierra_3: Setting Powered False 09:41:29.082199 bus /sierra_3: Setting Powered False 09:41:30.196270 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 09:41:31.472209 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:31.478072 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:41:31.530784 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:41:31.564638 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:41:31.621858 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:41:31.667674 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:41:31.697833 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:41:32.253435 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 09:41:32.259521 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:32.271371 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:41:32.310905 tst handover.py: using LAC 20580 09:41:32.438110 tst handover.py: using RAC 180 09:41:32.565533 tst handover.py: using CellId 20580 09:41:32.692460 tst handover.py: using BVCI 20581 09:41:32.807944 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:41:32.844742 tst handover.py: using LAC 20581 09:41:32.972248 tst handover.py: using RAC 181 09:41:33.096668 tst handover.py: using CellId 20581 09:41:33.221123 tst handover.py: using BVCI 20582 09:41:33.336602 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:33.348068 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:33.359308 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:33.371384 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:33.383321 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:33.395149 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:41:33.513336 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:41:33.629569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:34.066457 run create_hlr_db(pid=21544): Launched 09:41:34.188303 bus /sierra_2: Setting Powered False 09:41:35.248651 run create_hlr_db(pid=21544): Terminated: ok {rc=0} 09:41:35.657062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Launched 09:41:35.974251 run osmo-hlr_10.42.42.2(pid=21547): Launched 09:41:36.096229 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:36.621351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Launched 09:41:36.937868 run osmo-stp_10.42.42.5(pid=21550): Launched 09:41:37.059402 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:37.609396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21552): Launched 09:41:37.928662 run osmo-msc_10.42.42.6(pid=21553): Launched 09:41:38.107184 run osmo-stp_10.42.42.5(pid=21550): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] 09:41:38.242604 run osmo-stp_10.42.42.5(pid=21550): stdout: | (launched: 2022-12-09_09:41:36.880398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:38.378470 run osmo-stp_10.42.42.5(pid=21550): stderr: | [0;m[38;5;43m20221209094137065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094137065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094137065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094137066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094137066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094137066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094137066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:38.512121 run osmo-stp_10.42.42.5(pid=21550): stdout: | (launched: 2022-12-09_09:41:36.880398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:38.640295 run osmo-stp_10.42.42.5(pid=21550): stderr: | [0;m[38;5;43m20221209094137065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094137065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094137065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094137066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094137066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094137066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094137066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:38.793062 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21550): Process ended prematurely: osmo-stp_10.42.42.5(pid=21550) [trial-2357↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] [trial-2357↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 09:41:38.801892 tst handover.py:18: Test FAILED (6.5 sec) 09:41:38.829564 run osmo-hlr_10.42.42.2(pid=21547): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21547)] 09:41:38.880087 run osmo-hlr_10.42.42.2(pid=21547): stdout: | (launched: 2022-12-09_09:41:35.916711) 09:41:38.931909 run osmo-hlr_10.42.42.2(pid=21547): stderr: | [0;m[1;31m20221209094136109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094136109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094136109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094136109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094136109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094136109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094136124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094136134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094136134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094136134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:39.004183 run osmo-msc_10.42.42.6(pid=21553): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21553)] 09:41:39.053968 run osmo-msc_10.42.42.6(pid=21553): stdout: | (launched: 2022-12-09_09:41:37.870065) 09:41:39.105208 run osmo-msc_10.42.42.6(pid=21553): stderr: | [0;m[38;5;43m20221209094138187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094138187 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ba34fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094138187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094138187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094138188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094138188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094138190 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094138190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094138190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094138190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:39.157041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Terminating (SIGTERM) 09:41:39.198433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Terminating (SIGTERM) 09:41:39.239804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21552): Terminating (SIGTERM) 09:41:39.281413 --- ParallelTerminationStrategy: PID 21546 died... 09:41:39.301078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Terminated: ok {rc=0} 09:41:39.347050 --- ParallelTerminationStrategy: PID 21549 died... 09:41:39.366277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Terminated: ok {rc=0} 09:41:39.411921 --- ParallelTerminationStrategy: PID 21552 died... 09:41:39.431150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21552): Terminated: ok {rc=0} 09:41:39.518642 bus /sierra_3: Setting Powered False 09:41:40.617031 bus /sierra_3: Setting Powered False 09:41:41.731519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 09:41:42.987170 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:42.992567 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:41:43.048599 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:41:43.076052 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:41:43.127960 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:41:43.181808 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:41:43.208437 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:41:43.761991 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 09:41:43.767164 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:43.778250 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:41:43.818944 tst handover.py: using LAC 20582 09:41:43.934401 tst handover.py: using RAC 182 09:41:44.052248 tst handover.py: using CellId 20582 09:41:44.169881 tst handover.py: using BVCI 20583 09:41:44.277982 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:41:44.325734 tst handover.py: using LAC 20583 09:41:44.442136 tst handover.py: using RAC 183 09:41:44.563094 tst handover.py: using CellId 20583 09:41:44.680543 tst handover.py: using BVCI 20584 09:41:44.788348 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:44.799266 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:44.810167 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:44.820734 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:44.831470 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:44.842135 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:41:44.960762 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:41:45.079717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:45.547383 run create_hlr_db(pid=21558): Launched 09:41:45.671096 bus /sierra_2: Setting Powered False 09:41:46.733406 run create_hlr_db(pid=21558): Terminated: ok {rc=0} 09:41:47.164328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21560): Launched 09:41:47.473314 run osmo-hlr_10.42.42.2(pid=21561): Launched 09:41:47.589169 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:48.079287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21563): Launched 09:41:48.377254 run osmo-stp_10.42.42.5(pid=21564): Launched 09:41:48.490533 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:49.005337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21566): Launched 09:41:49.303085 run osmo-msc_10.42.42.6(pid=21567): Launched 09:41:49.469932 run osmo-stp_10.42.42.5(pid=21564): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21564)] 09:41:49.596501 run osmo-stp_10.42.42.5(pid=21564): stdout: | (launched: 2022-12-09_09:41:48.322708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:49.722933 run osmo-stp_10.42.42.5(pid=21564): stderr: | [0;m[38;5;43m20221209094148487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094148487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094148487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094148488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094148488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094148488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094148488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:49.847340 run osmo-stp_10.42.42.5(pid=21564): stdout: | (launched: 2022-12-09_09:41:48.322708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:49.966432 run osmo-stp_10.42.42.5(pid=21564): stderr: | [0;m[38;5;43m20221209094148487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094148487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094148487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094148488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094148488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094148488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094148488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:50.108681 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21564): Process ended prematurely: osmo-stp_10.42.42.5(pid=21564) [trial-2357↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21564)] [trial-2357↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 09:41:50.116899 tst handover.py:18: Test FAILED (6.3 sec) 09:41:50.143042 run osmo-hlr_10.42.42.2(pid=21561): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21561)] 09:41:50.190326 run osmo-hlr_10.42.42.2(pid=21561): stdout: | (launched: 2022-12-09_09:41:47.418636) 09:41:50.238869 run osmo-hlr_10.42.42.2(pid=21561): stderr: | [0;m[1;31m20221209094147591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094147591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094147591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094147591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094147591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094147591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094147608 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094147618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094147619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094147619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:50.306816 run osmo-msc_10.42.42.6(pid=21567): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21567)] 09:41:50.353753 run osmo-msc_10.42.42.6(pid=21567): stdout: | (launched: 2022-12-09_09:41:49.248493) 09:41:50.402236 run osmo-msc_10.42.42.6(pid=21567): stderr: | [0;m[38;5;43m20221209094149516 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094149517 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bef9ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094149517 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094149517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094149519 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094149520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094149520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094149521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:50.451315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21560): Terminating (SIGTERM) 09:41:50.490627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21563): Terminating (SIGTERM) 09:41:50.529823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21566): Terminating (SIGTERM) 09:41:50.569316 --- ParallelTerminationStrategy: PID 21560 died... 09:41:50.588124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21560): Terminated: ok {rc=0} 09:41:50.631354 --- ParallelTerminationStrategy: PID 21563 died... 09:41:50.649672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21563): Terminated: ok {rc=0} 09:41:50.693373 --- ParallelTerminationStrategy: PID 21566 died... 09:41:50.711671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21566): Terminated: ok {rc=0} 09:41:50.795213 bus /sierra_3: Setting Powered False 09:41:51.893750 bus /sierra_3: Setting Powered False 09:41:53.006597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 09:41:54.270745 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:54.276254 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:41:54.331980 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:41:54.360051 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:41:54.413853 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:41:54.468329 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:41:54.496384 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:41:55.049587 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 09:41:55.054833 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:41:55.066228 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:41:55.105353 tst handover.py: using LAC 20584 09:41:55.232274 tst handover.py: using RAC 184 09:41:55.357707 tst handover.py: using CellId 20584 09:41:55.476374 tst handover.py: using BVCI 20585 09:41:55.584577 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:41:55.633144 tst handover.py: using LAC 20585 09:41:55.750909 tst handover.py: using RAC 185 09:41:55.870457 tst handover.py: using CellId 20585 09:41:55.988879 tst handover.py: using BVCI 20586 09:41:56.096718 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:41:56.107804 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:41:56.118543 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:41:56.129253 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:41:56.140070 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:41:56.150816 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:41:56.268807 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:41:56.388634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:56.855460 run create_hlr_db(pid=21573): Launched 09:41:56.977248 bus /sierra_2: Setting Powered False 09:41:58.040246 run create_hlr_db(pid=21573): Terminated: ok {rc=0} 09:41:58.456826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21575): Launched 09:41:58.776028 run osmo-hlr_10.42.42.2(pid=21576): Launched 09:41:58.898489 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:59.423903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21578): Launched 09:41:59.742751 run osmo-stp_10.42.42.5(pid=21579): Launched 09:41:59.864882 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:00.414616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21581): Launched 09:42:00.733872 run osmo-msc_10.42.42.6(pid=21582): Launched 09:42:00.952124 run osmo-stp_10.42.42.5(pid=21579): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21579)] 09:42:01.258003 run osmo-stp_10.42.42.5(pid=21579): stdout: | (launched: 2022-12-09_09:41:59.685065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:01.476737 run osmo-stp_10.42.42.5(pid=21579): stderr: | [0;m[38;5;43m20221209094159869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094159869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094159869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094159870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094159870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094159870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094159870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:01.633680 run osmo-stp_10.42.42.5(pid=21579): stdout: | (launched: 2022-12-09_09:41:59.685065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:01.764790 run osmo-stp_10.42.42.5(pid=21579): stderr: | [0;m[38;5;43m20221209094159869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094159869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094159869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094159870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094159870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094159870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094159870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:01.922378 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21579): Process ended prematurely: osmo-stp_10.42.42.5(pid=21579) [trial-2357↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21579)] [trial-2357↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 09:42:01.932225 tst handover.py:18: Test FAILED (6.9 sec) 09:42:01.962916 run osmo-hlr_10.42.42.2(pid=21576): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21576)] 09:42:02.015731 run osmo-hlr_10.42.42.2(pid=21576): stdout: | (launched: 2022-12-09_09:41:58.718195) 09:42:02.069790 run osmo-hlr_10.42.42.2(pid=21576): stderr: | [0;m[1;31m20221209094158912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094158912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094158912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094158912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094158912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094158912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094158926 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094158934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094158934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094158934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:02.144131 run osmo-msc_10.42.42.6(pid=21582): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21582)] 09:42:02.196076 run osmo-msc_10.42.42.6(pid=21582): stdout: | (launched: 2022-12-09_09:42:00.675950) 09:42:02.249994 run osmo-msc_10.42.42.6(pid=21582): stderr: | [0;m[38;5;43m20221209094201171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094201171 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2e781d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094201172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094201172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094201172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094201172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094201175 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094201175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094201176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094201176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:02.304014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21575): Terminating (SIGTERM) 09:42:02.347722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21578): Terminating (SIGTERM) 09:42:02.391744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21581): Terminating (SIGTERM) 09:42:02.434505 --- ParallelTerminationStrategy: PID 21575 died... 09:42:02.454713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21575): Terminated: ok {rc=0} 09:42:02.502467 --- ParallelTerminationStrategy: PID 21578 died... 09:42:02.522031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21578): Terminated: ok {rc=0} 09:42:02.570330 --- ParallelTerminationStrategy: PID 21581 died... 09:42:02.589980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21581): Terminated: ok {rc=0} 09:42:02.679260 bus /sierra_3: Setting Powered False 09:42:03.776485 bus /sierra_3: Setting Powered False 09:42:04.891081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 09:42:06.155981 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:06.161378 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:42:06.199513 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:42:06.227986 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:42:06.281472 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:42:06.320626 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:42:06.348592 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:42:06.899911 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 09:42:06.905368 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:06.916475 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:42:06.952654 tst handover.py: using LAC 20586 09:42:07.077591 tst handover.py: using RAC 186 09:42:07.197217 tst handover.py: using CellId 20586 09:42:07.314774 tst handover.py: using BVCI 20587 09:42:07.424910 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:42:07.459372 tst handover.py: using LAC 20587 09:42:07.577363 tst handover.py: using RAC 187 09:42:07.694897 tst handover.py: using CellId 20587 09:42:07.814045 tst handover.py: using BVCI 20588 09:42:07.921939 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:07.932627 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:07.943330 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:07.953944 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:07.964508 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:42:07.975264 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:42:08.093385 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:42:08.215298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:08.686613 run create_hlr_db(pid=21589): Launched 09:42:08.809294 bus /sierra_2: Setting Powered False 09:42:09.872338 run create_hlr_db(pid=21589): Terminated: ok {rc=0} 09:42:10.290333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21591): Launched 09:42:10.611077 run osmo-hlr_10.42.42.2(pid=21592): Launched 09:42:10.733362 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:11.262158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21594): Launched 09:42:11.581627 run osmo-stp_10.42.42.5(pid=21595): Launched 09:42:11.704591 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:12.255684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21597): Launched 09:42:12.575674 run osmo-msc_10.42.42.6(pid=21598): Launched 09:42:12.754003 run osmo-stp_10.42.42.5(pid=21595): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21595)] 09:42:12.889646 run osmo-stp_10.42.42.5(pid=21595): stdout: | (launched: 2022-12-09_09:42:11.523043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:13.025462 run osmo-stp_10.42.42.5(pid=21595): stderr: | [0;m[38;5;43m20221209094211711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094211711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094211711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094211711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094211712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094211712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094211712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:13.160506 run osmo-stp_10.42.42.5(pid=21595): stdout: | (launched: 2022-12-09_09:42:11.523043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:13.288141 run osmo-stp_10.42.42.5(pid=21595): stderr: | [0;m[38;5;43m20221209094211711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094211711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094211711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094211711 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094211712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094211712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094211712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:13.440552 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21595): Process ended prematurely: osmo-stp_10.42.42.5(pid=21595) [trial-2357↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21595)] [trial-2357↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 09:42:13.449588 tst handover.py:18: Test FAILED (6.5 sec) 09:42:13.477157 run osmo-hlr_10.42.42.2(pid=21592): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21592)] 09:42:13.527250 run osmo-hlr_10.42.42.2(pid=21592): stdout: | (launched: 2022-12-09_09:42:10.552872) 09:42:13.579589 run osmo-hlr_10.42.42.2(pid=21592): stderr: | [0;m[1;31m20221209094210749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094210749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094210749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094210749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094210749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094210749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094210770 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094210779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094210780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094210780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:13.652032 run osmo-msc_10.42.42.6(pid=21598): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21598)] 09:42:13.702169 run osmo-msc_10.42.42.6(pid=21598): stdout: | (launched: 2022-12-09_09:42:12.517480) 09:42:13.754049 run osmo-msc_10.42.42.6(pid=21598): stderr: | [0;m[38;5;43m20221209094212834 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094212834 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7a9522c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094212834 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094212835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094212835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094212835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094212837 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094212837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094212837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094212837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:13.806326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21591): Terminating (SIGTERM) 09:42:13.848235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21594): Terminating (SIGTERM) 09:42:13.890362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21597): Terminating (SIGTERM) 09:42:13.932213 --- ParallelTerminationStrategy: PID 21591 died... 09:42:13.952225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21591): Terminated: ok {rc=0} 09:42:13.998842 --- ParallelTerminationStrategy: PID 21594 died... 09:42:14.018553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21594): Terminated: ok {rc=0} 09:42:14.065060 --- ParallelTerminationStrategy: PID 21597 died... 09:42:14.084364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21597): Terminated: ok {rc=0} 09:42:14.171185 bus /sierra_3: Setting Powered False 09:42:15.271339 bus /sierra_3: Setting Powered False 09:42:16.396999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 09:42:17.646138 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:17.651465 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:42:17.703076 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:42:17.730296 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:42:17.783238 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:42:17.834582 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:42:17.861201 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:42:18.411148 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 09:42:18.416267 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:42:18.427198 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:42:18.463569 tst handover.py: using LAC 20588 09:42:18.583432 tst handover.py: using RAC 188 09:42:18.701167 tst handover.py: using CellId 20588 09:42:18.821473 tst handover.py: using BVCI 20589 09:42:18.932533 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:42:18.981081 tst handover.py: using LAC 20589 09:42:19.096716 tst handover.py: using RAC 189 09:42:19.212702 tst handover.py: using CellId 20589 09:42:19.328925 tst handover.py: using BVCI 20590 09:42:19.437512 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:42:19.448300 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:42:19.458874 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:42:19.470238 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:42:19.481460 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:42:19.492605 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:42:19.613294 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:42:19.731088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:20.169692 run create_hlr_db(pid=21603): Launched 09:42:20.290868 bus /sierra_2: Setting Powered False 09:42:21.351429 run create_hlr_db(pid=21603): Terminated: ok {rc=0} 09:42:21.761892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21605): Launched 09:42:22.081370 run osmo-hlr_10.42.42.2(pid=21606): Launched 09:42:22.203562 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:22.729670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21608): Launched 09:42:23.047745 run osmo-stp_10.42.42.5(pid=21609): Launched 09:42:23.169709 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:23.720058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21611): Launched 09:42:24.021902 run osmo-msc_10.42.42.6(pid=21612): Launched 09:42:24.188827 run osmo-stp_10.42.42.5(pid=21609): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21609)] 09:42:24.315129 run osmo-stp_10.42.42.5(pid=21609): stdout: | (launched: 2022-12-09_09:42:22.989998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:24.442130 run osmo-stp_10.42.42.5(pid=21609): stderr: | [0;m[38;5;43m20221209094223176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094223177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094223177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094223178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094223178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094223178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094223178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:24.566872 run osmo-stp_10.42.42.5(pid=21609): stdout: | (launched: 2022-12-09_09:42:22.989998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:24.686242 run osmo-stp_10.42.42.5(pid=21609): stderr: | [0;m[38;5;43m20221209094223176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094223177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094223177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094223178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094223178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094223178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094223178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:24.827897 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21609): Process ended prematurely: osmo-stp_10.42.42.5(pid=21609) [trial-2357↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21609)] [trial-2357↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 09:42:24.836142 tst handover.py:18: Test FAILED (6.4 sec) 09:42:24.861715 run osmo-hlr_10.42.42.2(pid=21606): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21606)] 09:42:24.908537 run osmo-hlr_10.42.42.2(pid=21606): stdout: | (launched: 2022-12-09_09:42:22.023411) 09:42:24.956939 run osmo-hlr_10.42.42.2(pid=21606): stderr: | [0;m[1;31m20221209094222218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094222218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094222218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094222218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094222218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094222218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094222233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094222241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094222242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094222242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:25.024892 run osmo-msc_10.42.42.6(pid=21612): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21612)] 09:42:25.071494 run osmo-msc_10.42.42.6(pid=21612): stdout: | (launched: 2022-12-09_09:42:23.967229) 09:42:25.119880 run osmo-msc_10.42.42.6(pid=21612): stderr: | [0;m[38;5;43m20221209094224233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094224234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb22501dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094224234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094224234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094224234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094224234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094224236 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094224236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094224236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094224236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:25.168706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21605): Terminating (SIGTERM) 09:42:25.207780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21608): Terminating (SIGTERM) 09:42:25.246765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21611): Terminating (SIGTERM) 09:42:25.286111 --- ParallelTerminationStrategy: PID 21605 died... 09:42:25.304778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21605): Terminated: ok {rc=0} 09:42:25.348388 --- ParallelTerminationStrategy: PID 21608 died... 09:42:25.366626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21608): Terminated: ok {rc=0} 09:42:25.409362 --- ParallelTerminationStrategy: PID 21611 died... 09:42:25.427501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21611): Terminated: ok {rc=0} 09:42:25.511410 bus /sierra_3: Setting Powered False 09:42:26.610731 bus /sierra_3: Setting Powered False 09:42:27.724282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:42:28.979091 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:28.984073 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:42:29.030520 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:42:29.057335 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:42:29.110061 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:42:29.157309 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:42:29.183815 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:42:29.735423 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:42:29.742080 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:29.753627 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:42:29.789656 tst handover.py: using LAC 20590 09:42:29.916096 tst handover.py: using RAC 190 09:42:30.041300 tst handover.py: using CellId 20590 09:42:30.166049 tst handover.py: using BVCI 20591 09:42:30.281735 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:42:30.327983 tst handover.py: using LAC 20591 09:42:30.453740 tst handover.py: using RAC 191 09:42:30.580190 tst handover.py: using CellId 20591 09:42:30.706343 tst handover.py: using BVCI 20592 09:42:30.822975 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:30.838193 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:30.850783 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:30.867534 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:30.886839 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:30.901009 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:42:31.036196 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:42:31.157054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:31.659206 run create_hlr_db(pid=21617): Launched 09:42:31.812901 bus /sierra_2: Setting Powered False 09:42:32.876153 run create_hlr_db(pid=21617): Terminated: ok {rc=0} 09:42:33.292288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21619): Launched 09:42:33.612128 run osmo-hlr_10.42.42.2(pid=21620): Launched 09:42:33.734488 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:34.255067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21622): Launched 09:42:34.575399 run osmo-stp_10.42.42.5(pid=21623): Launched 09:42:34.698242 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:35.248685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21625): Launched 09:42:35.568702 run osmo-msc_10.42.42.6(pid=21626): Launched 09:42:35.748312 run osmo-stp_10.42.42.5(pid=21623): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21623)] 09:42:35.892244 run osmo-stp_10.42.42.5(pid=21623): stdout: | (launched: 2022-12-09_09:42:34.516687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:36.028780 run osmo-stp_10.42.42.5(pid=21623): stderr: | [0;m[38;5;43m20221209094234703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094234703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094234703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094234704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094234704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094234704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094234704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:36.163279 run osmo-stp_10.42.42.5(pid=21623): stdout: | (launched: 2022-12-09_09:42:34.516687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:36.291598 run osmo-stp_10.42.42.5(pid=21623): stderr: | [0;m[38;5;43m20221209094234703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094234703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094234703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094234704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094234704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094234704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094234704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:36.444536 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21623): Process ended prematurely: osmo-stp_10.42.42.5(pid=21623) [trial-2357↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21623)] [trial-2357↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 09:42:36.453691 tst handover.py:18: Test FAILED (6.7 sec) 09:42:36.482196 run osmo-hlr_10.42.42.2(pid=21620): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21620)] 09:42:36.532775 run osmo-hlr_10.42.42.2(pid=21620): stdout: | (launched: 2022-12-09_09:42:33.553798) 09:42:36.585286 run osmo-hlr_10.42.42.2(pid=21620): stderr: | [0;m[1;31m20221209094233748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094233748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094233748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094233748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094233748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094233748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094233762 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094233772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094233772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094233772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:36.657689 run osmo-msc_10.42.42.6(pid=21626): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21626)] 09:42:36.707595 run osmo-msc_10.42.42.6(pid=21626): stdout: | (launched: 2022-12-09_09:42:35.510501) 09:42:36.759258 run osmo-msc_10.42.42.6(pid=21626): stderr: | [0;m[38;5;43m20221209094235830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094235830 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15fb21fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094235830 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094235830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094235830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094235831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094235832 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094235833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094235833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094235833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:36.811585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21619): Terminating (SIGTERM) 09:42:36.853496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21622): Terminating (SIGTERM) 09:42:36.895315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21625): Terminating (SIGTERM) 09:42:36.937447 --- ParallelTerminationStrategy: PID 21619 died... 09:42:36.957292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21619): Terminated: ok {rc=0} 09:42:37.003803 --- ParallelTerminationStrategy: PID 21622 died... 09:42:37.023211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21622): Terminated: ok {rc=0} 09:42:37.069410 --- ParallelTerminationStrategy: PID 21625 died... 09:42:37.088658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21625): Terminated: ok {rc=0} 09:42:37.175537 bus /sierra_3: Setting Powered False 09:42:38.273446 bus /sierra_3: Setting Powered False 09:42:39.390001 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:42:40.646710 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:40.651993 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:42:40.702802 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:42:40.729527 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:42:40.782808 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:42:40.833865 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:42:40.860198 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:42:41.412149 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:42:41.417228 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:41.428340 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:42:41.462370 tst handover.py: using LAC 20592 09:42:41.589515 tst handover.py: using RAC 192 09:42:41.709574 tst handover.py: using CellId 20592 09:42:41.835458 tst handover.py: using BVCI 20593 09:42:41.951958 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:42:42.002982 tst handover.py: using LAC 20593 09:42:42.132332 tst handover.py: using RAC 193 09:42:42.257244 tst handover.py: using CellId 20593 09:42:42.383335 tst handover.py: using BVCI 20594 09:42:42.500084 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:42.511610 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:42.522941 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:42.534494 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:42.546277 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:42.558237 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:42:42.675636 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:42:42.791190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:43.230537 run create_hlr_db(pid=21631): Launched 09:42:43.353580 bus /sierra_2: Setting Powered False 09:42:44.413803 run create_hlr_db(pid=21631): Terminated: ok {rc=0} 09:42:44.805898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21633): Launched 09:42:45.104313 run osmo-hlr_10.42.42.2(pid=21634): Launched 09:42:45.217772 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:45.706255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21636): Launched 09:42:46.040132 run osmo-stp_10.42.42.5(pid=21637): Launched 09:42:46.325065 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:47.093682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21639): Launched 09:42:47.434170 run osmo-msc_10.42.42.6(pid=21640): Launched 09:42:47.617194 run osmo-stp_10.42.42.5(pid=21637): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21637)] 09:42:47.755900 run osmo-stp_10.42.42.5(pid=21637): stdout: | (launched: 2022-12-09_09:42:45.974747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:47.894203 run osmo-stp_10.42.42.5(pid=21637): stderr: | [0;m[38;5;43m20221209094246374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094246374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094246375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094246376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094246376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094246377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094246377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:48.030864 run osmo-stp_10.42.42.5(pid=21637): stdout: | (launched: 2022-12-09_09:42:45.974747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:48.160678 run osmo-stp_10.42.42.5(pid=21637): stderr: | [0;m[38;5;43m20221209094246374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094246374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094246375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094246376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094246376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094246377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094246377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:48.315301 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21637): Process ended prematurely: osmo-stp_10.42.42.5(pid=21637) [trial-2357↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21637)] [trial-2357↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 09:42:48.324195 tst handover.py:18: Test FAILED (6.9 sec) 09:42:48.352255 run osmo-hlr_10.42.42.2(pid=21634): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21634)] 09:42:48.402159 run osmo-hlr_10.42.42.2(pid=21634): stdout: | (launched: 2022-12-09_09:42:45.049935) 09:42:48.454154 run osmo-hlr_10.42.42.2(pid=21634): stderr: | [0;m[1;31m20221209094245221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094245221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094245221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094245221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094245221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094245221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094245237 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094245247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094245247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094245248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:48.526226 run osmo-msc_10.42.42.6(pid=21640): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21640)] 09:42:48.576388 run osmo-msc_10.42.42.6(pid=21640): stdout: | (launched: 2022-12-09_09:42:47.375247) 09:42:48.628503 run osmo-msc_10.42.42.6(pid=21640): stderr: | [0;m[38;5;43m20221209094247691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094247691 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb83fbd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094247691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094247691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094247691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094247692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094247693 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094247694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094247694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094247694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:48.680683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21633): Terminating (SIGTERM) 09:42:48.722511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21636): Terminating (SIGTERM) 09:42:48.764396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21639): Terminating (SIGTERM) 09:42:48.806622 --- ParallelTerminationStrategy: PID 21633 died... 09:42:48.826521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21633): Terminated: ok {rc=0} 09:42:48.873470 --- ParallelTerminationStrategy: PID 21636 died... 09:42:48.892930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21636): Terminated: ok {rc=0} 09:42:48.939726 --- ParallelTerminationStrategy: PID 21639 died... 09:42:48.959373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21639): Terminated: ok {rc=0} 09:42:49.047638 bus /sierra_3: Setting Powered False 09:42:50.147743 bus /sierra_3: Setting Powered False 09:42:51.265083 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 09:42:52.522651 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:52.527633 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:42:52.566786 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:42:52.593910 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:42:52.647366 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:42:52.687580 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:42:52.714506 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:42:53.263248 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 09:42:53.268691 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:53.279748 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:42:53.314166 tst handover.py: using LAC 20594 09:42:53.435766 tst handover.py: using RAC 194 09:42:53.556935 tst handover.py: using CellId 20594 09:42:53.677378 tst handover.py: using BVCI 20595 09:42:53.786944 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:42:53.821432 tst handover.py: using LAC 20595 09:42:53.942691 tst handover.py: using RAC 195 09:42:54.063288 tst handover.py: using CellId 20595 09:42:54.183778 tst handover.py: using BVCI 20596 09:42:54.303805 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:54.315342 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:54.326829 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:54.338655 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:54.350240 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:54.361927 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:42:54.480002 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:42:54.595883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:55.040708 run create_hlr_db(pid=21645): Launched 09:42:55.165564 bus /sierra_2: Setting Powered False 09:42:56.226333 run create_hlr_db(pid=21645): Terminated: ok {rc=0} 09:42:56.641588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21647): Launched 09:42:56.966782 run osmo-hlr_10.42.42.2(pid=21648): Launched 09:42:57.090731 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:57.624010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21650): Launched 09:42:57.949229 run osmo-stp_10.42.42.5(pid=21651): Launched 09:42:58.074138 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:58.636027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21653): Launched 09:42:58.961851 run osmo-msc_10.42.42.6(pid=21654): Launched 09:42:59.143468 run osmo-stp_10.42.42.5(pid=21651): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21651)] 09:42:59.281171 run osmo-stp_10.42.42.5(pid=21651): stdout: | (launched: 2022-12-09_09:42:57.890060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:59.418996 run osmo-stp_10.42.42.5(pid=21651): stderr: | [0;m[38;5;43m20221209094258076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094258077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094258077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094258077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094258078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094258078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094258078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:59.555183 run osmo-stp_10.42.42.5(pid=21651): stdout: | (launched: 2022-12-09_09:42:57.890060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:59.685330 run osmo-stp_10.42.42.5(pid=21651): stderr: | [0;m[38;5;43m20221209094258076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094258077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094258077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094258077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094258078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094258078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094258078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:59.839990 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21651): Process ended prematurely: osmo-stp_10.42.42.5(pid=21651) [trial-2357↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21651)] [trial-2357↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 09:42:59.849139 tst handover.py:18: Test FAILED (6.6 sec) 09:42:59.876716 run osmo-hlr_10.42.42.2(pid=21648): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21648)] 09:42:59.927422 run osmo-hlr_10.42.42.2(pid=21648): stdout: | (launched: 2022-12-09_09:42:56.907953) 09:42:59.979627 run osmo-hlr_10.42.42.2(pid=21648): stderr: | [0;m[1;31m20221209094257102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094257102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094257102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094257102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094257102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094257102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094257116 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094257124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094257124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094257124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:00.052541 run osmo-msc_10.42.42.6(pid=21654): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21654)] 09:43:00.102834 run osmo-msc_10.42.42.6(pid=21654): stdout: | (launched: 2022-12-09_09:42:58.902800) 09:43:00.154802 run osmo-msc_10.42.42.6(pid=21654): stderr: | [0;m[38;5;43m20221209094259219 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094259219 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff7be1cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094259219 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094259219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094259219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094259220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094259221 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094259222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094259222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094259222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:00.206644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21647): Terminating (SIGTERM) 09:43:00.248253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21650): Terminating (SIGTERM) 09:43:00.290708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21653): Terminating (SIGTERM) 09:43:00.332474 --- ParallelTerminationStrategy: PID 21647 died... 09:43:00.352749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21647): Terminated: ok {rc=0} 09:43:00.399448 --- ParallelTerminationStrategy: PID 21650 died... 09:43:00.419021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21650): Terminated: ok {rc=0} 09:43:00.465274 --- ParallelTerminationStrategy: PID 21653 died... 09:43:00.484471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21653): Terminated: ok {rc=0} 09:43:00.571445 bus /sierra_3: Setting Powered False 09:43:01.672823 bus /sierra_3: Setting Powered False 09:43:02.787077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 09:43:04.033067 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:04.038987 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:43:04.092497 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:43:04.120486 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:43:04.173976 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:43:04.226648 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:43:04.254653 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:43:04.806861 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 09:43:04.812578 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:04.823805 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:43:04.862055 tst handover.py: using LAC 20596 09:43:04.983997 tst handover.py: using RAC 196 09:43:05.102276 tst handover.py: using CellId 20596 09:43:05.221604 tst handover.py: using BVCI 20597 09:43:05.331491 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:43:05.379787 tst handover.py: using LAC 20597 09:43:05.497394 tst handover.py: using RAC 197 09:43:05.615565 tst handover.py: using CellId 20597 09:43:05.734970 tst handover.py: using BVCI 20598 09:43:05.854652 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:05.866135 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:05.877508 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:05.889093 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:05.900549 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:05.912081 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:43:06.030983 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:43:06.147784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:06.623518 run create_hlr_db(pid=21659): Launched 09:43:06.748459 bus /sierra_2: Setting Powered False 09:43:07.811644 run create_hlr_db(pid=21659): Terminated: ok {rc=0} 09:43:08.233637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21661): Launched 09:43:08.557621 run osmo-hlr_10.42.42.2(pid=21662): Launched 09:43:08.681990 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:09.216879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21664): Launched 09:43:09.540445 run osmo-stp_10.42.42.5(pid=21665): Launched 09:43:09.665928 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:10.222751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21667): Launched 09:43:10.547616 run osmo-msc_10.42.42.6(pid=21668): Launched 09:43:10.729352 run osmo-stp_10.42.42.5(pid=21665): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21665)] 09:43:10.866271 run osmo-stp_10.42.42.5(pid=21665): stdout: | (launched: 2022-12-09_09:43:09.481510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:11.003435 run osmo-stp_10.42.42.5(pid=21665): stderr: | [0;m[38;5;43m20221209094309668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094309668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094309668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094309669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094309669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094309669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094309669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:11.138889 run osmo-stp_10.42.42.5(pid=21665): stdout: | (launched: 2022-12-09_09:43:09.481510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:11.268658 run osmo-stp_10.42.42.5(pid=21665): stderr: | [0;m[38;5;43m20221209094309668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094309668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094309668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094309669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094309669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094309669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094309669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:11.423488 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21665): Process ended prematurely: osmo-stp_10.42.42.5(pid=21665) [trial-2357↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21665)] [trial-2357↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 09:43:11.432305 tst handover.py:18: Test FAILED (6.6 sec) 09:43:11.460050 run osmo-hlr_10.42.42.2(pid=21662): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21662)] 09:43:11.509883 run osmo-hlr_10.42.42.2(pid=21662): stdout: | (launched: 2022-12-09_09:43:08.498720) 09:43:11.561366 run osmo-hlr_10.42.42.2(pid=21662): stderr: | [0;m[1;31m20221209094308692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094308692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094308693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094308693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094308693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094308693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094308706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094308714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094308714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094308714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:11.633408 run osmo-msc_10.42.42.6(pid=21668): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21668)] 09:43:11.683000 run osmo-msc_10.42.42.6(pid=21668): stdout: | (launched: 2022-12-09_09:43:10.488498) 09:43:11.734635 run osmo-msc_10.42.42.6(pid=21668): stderr: | [0;m[38;5;43m20221209094310810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094310810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3be9d20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094310810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094310810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094310811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094310811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094310813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094310813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094310813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094310813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:11.786376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21661): Terminating (SIGTERM) 09:43:11.827895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21664): Terminating (SIGTERM) 09:43:11.869400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21667): Terminating (SIGTERM) 09:43:11.911008 --- ParallelTerminationStrategy: PID 21661 died... 09:43:11.930652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21661): Terminated: ok {rc=0} 09:43:11.976363 --- ParallelTerminationStrategy: PID 21664 died... 09:43:11.995421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21664): Terminated: ok {rc=0} 09:43:12.041544 --- ParallelTerminationStrategy: PID 21667 died... 09:43:12.060550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21667): Terminated: ok {rc=0} 09:43:12.146477 bus /sierra_3: Setting Powered False 09:43:13.244098 bus /sierra_3: Setting Powered False 09:43:14.358410 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 09:43:15.612637 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:15.617797 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:43:15.668106 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:43:15.695075 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:43:15.745725 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:43:15.796300 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:43:15.824616 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:43:16.407701 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 09:43:16.415752 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:16.434862 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:43:16.482336 tst handover.py: using LAC 20598 09:43:16.636181 tst handover.py: using RAC 198 09:43:16.795888 tst handover.py: using CellId 20598 09:43:16.946692 tst handover.py: using BVCI 20599 09:43:17.067840 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:43:17.118967 tst handover.py: using LAC 20599 09:43:17.251167 tst handover.py: using RAC 199 09:43:17.378827 tst handover.py: using CellId 20599 09:43:17.497017 tst handover.py: using BVCI 20600 09:43:17.606440 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:17.618009 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:17.628882 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:17.639940 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:17.650984 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:17.661808 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:43:17.782237 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:43:17.899513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:18.345660 run create_hlr_db(pid=21673): Launched 09:43:18.470697 bus /sierra_2: Setting Powered False 09:43:19.531231 run create_hlr_db(pid=21673): Terminated: ok {rc=0} 09:43:19.928366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21675): Launched 09:43:20.233092 run osmo-hlr_10.42.42.2(pid=21676): Launched 09:43:20.349632 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:20.850662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21678): Launched 09:43:21.153892 run osmo-stp_10.42.42.5(pid=21679): Launched 09:43:21.268746 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:21.791045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21681): Launched 09:43:22.093620 run osmo-msc_10.42.42.6(pid=21682): Launched 09:43:22.262300 run osmo-stp_10.42.42.5(pid=21679): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21679)] 09:43:22.390771 run osmo-stp_10.42.42.5(pid=21679): stdout: | (launched: 2022-12-09_09:43:21.098034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:22.518364 run osmo-stp_10.42.42.5(pid=21679): stderr: | [0;m[38;5;43m20221209094321262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094321262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094321263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094321263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094321264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094321264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094321264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:22.644359 run osmo-stp_10.42.42.5(pid=21679): stdout: | (launched: 2022-12-09_09:43:21.098034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:22.764639 run osmo-stp_10.42.42.5(pid=21679): stderr: | [0;m[38;5;43m20221209094321262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094321262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094321263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094321263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094321264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094321264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094321264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:22.909270 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21679): Process ended prematurely: osmo-stp_10.42.42.5(pid=21679) [trial-2357↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21679)] [trial-2357↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 09:43:22.917421 tst handover.py:18: Test FAILED (6.5 sec) 09:43:22.943262 run osmo-hlr_10.42.42.2(pid=21676): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21676)] 09:43:22.990555 run osmo-hlr_10.42.42.2(pid=21676): stdout: | (launched: 2022-12-09_09:43:20.177377) 09:43:23.039153 run osmo-hlr_10.42.42.2(pid=21676): stderr: | [0;m[1;31m20221209094320351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094320351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094320351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094320351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094320351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094320351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094320364 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094320372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094320373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094320373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:23.107136 run osmo-msc_10.42.42.6(pid=21682): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21682)] 09:43:23.154183 run osmo-msc_10.42.42.6(pid=21682): stdout: | (launched: 2022-12-09_09:43:22.037982) 09:43:23.202667 run osmo-msc_10.42.42.6(pid=21682): stderr: | [0;m[38;5;43m20221209094322306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094322306 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5f440dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094322306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094322306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094322307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094322307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094322308 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094322309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094322309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094322309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:23.251593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21675): Terminating (SIGTERM) 09:43:23.290773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21678): Terminating (SIGTERM) 09:43:23.330005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21681): Terminating (SIGTERM) 09:43:23.369441 --- ParallelTerminationStrategy: PID 21675 died... 09:43:23.388161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21675): Terminated: ok {rc=0} 09:43:23.431453 --- ParallelTerminationStrategy: PID 21678 died... 09:43:23.449710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21678): Terminated: ok {rc=0} 09:43:23.492594 --- ParallelTerminationStrategy: PID 21681 died... 09:43:23.510921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21681): Terminated: ok {rc=0} 09:43:23.595619 bus /sierra_3: Setting Powered False 09:43:24.694825 bus /sierra_3: Setting Powered False 09:43:25.809301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 09:43:27.064170 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:27.069195 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:43:27.118192 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:43:27.144896 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:43:27.197630 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:43:27.248181 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:43:27.275115 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:43:27.829911 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 09:43:27.836374 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:27.848099 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:43:27.885724 tst handover.py: using LAC 20600 09:43:28.012152 tst handover.py: using RAC 200 09:43:28.132289 tst handover.py: using CellId 20600 09:43:28.250254 tst handover.py: using BVCI 20601 09:43:28.360070 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:43:28.407106 tst handover.py: using LAC 20601 09:43:28.524241 tst handover.py: using RAC 201 09:43:28.641979 tst handover.py: using CellId 20601 09:43:28.759734 tst handover.py: using BVCI 20602 09:43:28.870067 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:28.881072 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:28.891849 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:28.902721 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:28.913845 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:43:28.924660 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:43:29.041444 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:43:29.156551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:29.600457 run create_hlr_db(pid=21687): Launched 09:43:29.724127 bus /sierra_2: Setting Powered False 09:43:30.785163 run create_hlr_db(pid=21687): Terminated: ok {rc=0} 09:43:31.237584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21689): Launched 09:43:31.585314 run osmo-hlr_10.42.42.2(pid=21690): Launched 09:43:31.721792 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:32.409855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21692): Launched 09:43:32.713569 run osmo-stp_10.42.42.5(pid=21693): Launched 09:43:32.828577 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:33.351843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21695): Launched 09:43:33.654800 run osmo-msc_10.42.42.6(pid=21696): Launched 09:43:33.823491 run osmo-stp_10.42.42.5(pid=21693): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21693)] 09:43:33.951703 run osmo-stp_10.42.42.5(pid=21693): stdout: | (launched: 2022-12-09_09:43:32.658000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:34.079539 run osmo-stp_10.42.42.5(pid=21693): stderr: | [0;m[38;5;43m20221209094332827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094332827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094332827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094332828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094332828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094332828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094332828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:34.205731 run osmo-stp_10.42.42.5(pid=21693): stdout: | (launched: 2022-12-09_09:43:32.658000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:34.326172 run osmo-stp_10.42.42.5(pid=21693): stderr: | [0;m[38;5;43m20221209094332827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094332827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094332827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094332828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094332828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094332828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094332828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:34.470075 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21693): Process ended prematurely: osmo-stp_10.42.42.5(pid=21693) [trial-2357↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21693)] [trial-2357↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 09:43:34.478476 tst handover.py:18: Test FAILED (6.6 sec) 09:43:34.504307 run osmo-hlr_10.42.42.2(pid=21690): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21690)] 09:43:34.551515 run osmo-hlr_10.42.42.2(pid=21690): stdout: | (launched: 2022-12-09_09:43:31.520642) 09:43:34.600242 run osmo-hlr_10.42.42.2(pid=21690): stderr: | [0;m[1;31m20221209094331940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094331940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094331940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094331940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094331940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094331940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094331971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094331992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094331995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094332000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:34.668223 run osmo-msc_10.42.42.6(pid=21696): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21696)] 09:43:34.715306 run osmo-msc_10.42.42.6(pid=21696): stdout: | (launched: 2022-12-09_09:43:33.599018) 09:43:34.763968 run osmo-msc_10.42.42.6(pid=21696): stderr: | [0;m[38;5;43m20221209094333868 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094333868 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb859a42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094333868 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094333868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094333868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094333869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094333870 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094333871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094333871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094333871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:34.812813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21689): Terminating (SIGTERM) 09:43:34.852116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21692): Terminating (SIGTERM) 09:43:34.891402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21695): Terminating (SIGTERM) 09:43:34.931032 --- ParallelTerminationStrategy: PID 21689 died... 09:43:34.950033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21689): Terminated: ok {rc=0} 09:43:34.994529 --- ParallelTerminationStrategy: PID 21692 died... 09:43:35.012938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21692): Terminated: ok {rc=0} 09:43:35.056509 --- ParallelTerminationStrategy: PID 21695 died... 09:43:35.075089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21695): Terminated: ok {rc=0} 09:43:35.157291 bus /sierra_3: Setting Powered False 09:43:36.254860 bus /sierra_3: Setting Powered False 09:43:37.370335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:43:38.631831 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:38.637986 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:43:38.683279 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:43:38.710274 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:43:38.763727 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:43:38.809140 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:43:38.835783 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:43:39.393650 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:43:39.399905 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:39.411387 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:43:39.445323 tst handover.py: using LAC 20602 09:43:39.564023 tst handover.py: using RAC 202 09:43:39.684860 tst handover.py: using CellId 20602 09:43:39.808608 tst handover.py: using BVCI 20603 09:43:39.920328 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:43:39.963953 tst handover.py: using LAC 20603 09:43:40.083232 tst handover.py: using RAC 203 09:43:40.202802 tst handover.py: using CellId 20603 09:43:40.322806 tst handover.py: using BVCI 20604 09:43:40.434572 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:40.445919 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:40.456874 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:40.467944 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:40.478970 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:43:40.490029 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:43:40.609444 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:43:40.728218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:41.205496 run create_hlr_db(pid=21701): Launched 09:43:41.330521 bus /sierra_2: Setting Powered False 09:43:42.394684 run create_hlr_db(pid=21701): Terminated: ok {rc=0} 09:43:42.819855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21703): Launched 09:43:43.145407 run osmo-hlr_10.42.42.2(pid=21704): Launched 09:43:43.269938 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:43.799658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21706): Launched 09:43:44.124128 run osmo-stp_10.42.42.5(pid=21707): Launched 09:43:44.248900 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:44.806953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21709): Launched 09:43:45.132367 run osmo-msc_10.42.42.6(pid=21710): Launched 09:43:45.315136 run osmo-stp_10.42.42.5(pid=21707): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21707)] 09:43:45.453731 run osmo-stp_10.42.42.5(pid=21707): stdout: | (launched: 2022-12-09_09:43:44.064828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:45.592097 run osmo-stp_10.42.42.5(pid=21707): stderr: | [0;m[38;5;43m20221209094344254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094344254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094344254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094344255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094344255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094344255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094344255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:45.728812 run osmo-stp_10.42.42.5(pid=21707): stdout: | (launched: 2022-12-09_09:43:44.064828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:45.870009 run osmo-stp_10.42.42.5(pid=21707): stderr: | [0;m[38;5;43m20221209094344254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094344254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094344254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094344255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094344255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094344255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094344255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:46.031280 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21707): Process ended prematurely: osmo-stp_10.42.42.5(pid=21707) [trial-2357↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21707)] [trial-2357↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 09:43:46.040994 tst handover.py:18: Test FAILED (6.6 sec) 09:43:46.070668 run osmo-hlr_10.42.42.2(pid=21704): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21704)] 09:43:46.122331 run osmo-hlr_10.42.42.2(pid=21704): stdout: | (launched: 2022-12-09_09:43:43.086179) 09:43:46.175383 run osmo-hlr_10.42.42.2(pid=21704): stderr: | [0;m[1;31m20221209094343279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094343279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094343279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094343279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094343279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094343279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094343292 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094343301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094343301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094343301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:46.248940 run osmo-msc_10.42.42.6(pid=21710): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21710)] 09:43:46.300378 run osmo-msc_10.42.42.6(pid=21710): stdout: | (launched: 2022-12-09_09:43:45.073399) 09:43:46.353516 run osmo-msc_10.42.42.6(pid=21710): stderr: | [0;m[38;5;43m20221209094345392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094345392 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f45940c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094345392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094345392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094345392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094345393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094345394 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094345395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094345395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094345395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:46.407160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21703): Terminating (SIGTERM) 09:43:46.450589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21706): Terminating (SIGTERM) 09:43:46.494051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21709): Terminating (SIGTERM) 09:43:46.537417 --- ParallelTerminationStrategy: PID 21703 died... 09:43:46.557738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21703): Terminated: ok {rc=0} 09:43:46.606362 --- ParallelTerminationStrategy: PID 21706 died... 09:43:46.626562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21706): Terminated: ok {rc=0} 09:43:46.674730 --- ParallelTerminationStrategy: PID 21709 died... 09:43:46.695020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21709): Terminated: ok {rc=0} 09:43:46.794750 bus /sierra_3: Setting Powered False 09:43:47.894698 bus /sierra_3: Setting Powered False 09:43:49.010245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:43:50.268539 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:50.274081 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:43:50.326832 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:43:50.354740 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:43:50.408120 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:43:50.459469 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:43:50.487058 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:43:51.039565 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:43:51.044935 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:51.056343 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:43:51.091162 tst handover.py: using LAC 20604 09:43:51.211243 tst handover.py: using RAC 204 09:43:51.330386 tst handover.py: using CellId 20604 09:43:51.451220 tst handover.py: using BVCI 20605 09:43:51.562586 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:43:51.612677 tst handover.py: using LAC 20605 09:43:51.742143 tst handover.py: using RAC 205 09:43:51.868617 tst handover.py: using CellId 20605 09:43:51.996769 tst handover.py: using BVCI 20606 09:43:52.117591 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:52.129488 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:52.141106 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:52.153143 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:52.165791 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:52.178292 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:43:52.295683 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:43:52.411771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:52.855695 run create_hlr_db(pid=21715): Launched 09:43:52.979290 bus /sierra_2: Setting Powered False 09:43:54.039907 run create_hlr_db(pid=21715): Terminated: ok {rc=0} 09:43:54.452619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21717): Launched 09:43:54.777230 run osmo-hlr_10.42.42.2(pid=21718): Launched 09:43:54.901728 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:55.433528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21720): Launched 09:43:55.757999 run osmo-stp_10.42.42.5(pid=21721): Launched 09:43:55.881909 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:56.440675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21723): Launched 09:43:56.765494 run osmo-msc_10.42.42.6(pid=21724): Launched 09:43:56.946908 run osmo-stp_10.42.42.5(pid=21721): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21721)] 09:43:57.084886 run osmo-stp_10.42.42.5(pid=21721): stdout: | (launched: 2022-12-09_09:43:55.699136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:57.222913 run osmo-stp_10.42.42.5(pid=21721): stderr: | [0;m[38;5;43m20221209094355886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094355886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094355887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094355887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094355888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094355888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094355888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:57.358807 run osmo-stp_10.42.42.5(pid=21721): stdout: | (launched: 2022-12-09_09:43:55.699136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:57.488480 run osmo-stp_10.42.42.5(pid=21721): stderr: | [0;m[38;5;43m20221209094355886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094355886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094355887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094355887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094355888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094355888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094355888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:57.643922 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21721): Process ended prematurely: osmo-stp_10.42.42.5(pid=21721) [trial-2357↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21721)] [trial-2357↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 09:43:57.652996 tst handover.py:18: Test FAILED (6.6 sec) 09:43:57.681382 run osmo-hlr_10.42.42.2(pid=21718): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21718)] 09:43:57.731550 run osmo-hlr_10.42.42.2(pid=21718): stdout: | (launched: 2022-12-09_09:43:54.718022) 09:43:57.783844 run osmo-hlr_10.42.42.2(pid=21718): stderr: | [0;m[1;31m20221209094354912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094354912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094354912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094354912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094354913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094354913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094354925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094354935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094354935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094354935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:57.856319 run osmo-msc_10.42.42.6(pid=21724): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21724)] 09:43:57.906597 run osmo-msc_10.42.42.6(pid=21724): stdout: | (launched: 2022-12-09_09:43:56.706312) 09:43:57.958507 run osmo-msc_10.42.42.6(pid=21724): stderr: | [0;m[38;5;43m20221209094357022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094357022 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7172933c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094357022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094357023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094357023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094357023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094357025 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094357025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094357025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094357025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:58.011104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21717): Terminating (SIGTERM) 09:43:58.053212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21720): Terminating (SIGTERM) 09:43:58.095349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21723): Terminating (SIGTERM) 09:43:58.137778 --- ParallelTerminationStrategy: PID 21717 died... 09:43:58.157647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21717): Terminated: ok {rc=0} 09:43:58.204661 --- ParallelTerminationStrategy: PID 21720 died... 09:43:58.224126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21720): Terminated: ok {rc=0} 09:43:58.271245 --- ParallelTerminationStrategy: PID 21723 died... 09:43:58.290969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21723): Terminated: ok {rc=0} 09:43:58.378292 bus /sierra_3: Setting Powered False 09:43:59.477072 bus /sierra_3: Setting Powered False 09:44:00.591646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 09:44:01.860758 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:01.870313 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:44:01.920524 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:44:01.955640 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:44:02.007929 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:44:02.055167 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:44:02.090190 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:44:02.628217 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 09:44:02.634003 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:02.645610 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:44:02.681372 tst handover.py: using LAC 20606 09:44:02.811836 tst handover.py: using RAC 206 09:44:02.938742 tst handover.py: using CellId 20606 09:44:03.064144 tst handover.py: using BVCI 20607 09:44:03.182240 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:44:03.216694 tst handover.py: using LAC 20607 09:44:03.342616 tst handover.py: using RAC 207 09:44:03.468235 tst handover.py: using CellId 20607 09:44:03.594718 tst handover.py: using BVCI 20608 09:44:03.713886 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:03.725481 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:03.736765 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:03.748619 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:03.760295 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:03.772028 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:44:03.893122 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:44:04.014597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:04.489768 run create_hlr_db(pid=21729): Launched 09:44:04.613491 bus /sierra_2: Setting Powered False 09:44:05.677464 run create_hlr_db(pid=21729): Terminated: ok {rc=0} 09:44:06.099570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21732): Launched 09:44:06.423667 run osmo-hlr_10.42.42.2(pid=21733): Launched 09:44:06.547168 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:07.077083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21735): Launched 09:44:07.401969 run osmo-stp_10.42.42.5(pid=21736): Launched 09:44:07.525934 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:08.085287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21738): Launched 09:44:08.409758 run osmo-msc_10.42.42.6(pid=21739): Launched 09:44:08.590981 run osmo-stp_10.42.42.5(pid=21736): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21736)] 09:44:08.729243 run osmo-stp_10.42.42.5(pid=21736): stdout: | (launched: 2022-12-09_09:44:07.342763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:08.867102 run osmo-stp_10.42.42.5(pid=21736): stderr: | [0;m[38;5;43m20221209094407530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094407530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094407530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094407531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094407531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094407531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094407531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:09.003460 run osmo-stp_10.42.42.5(pid=21736): stdout: | (launched: 2022-12-09_09:44:07.342763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:09.133279 run osmo-stp_10.42.42.5(pid=21736): stderr: | [0;m[38;5;43m20221209094407530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094407530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094407530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094407531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094407531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094407531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094407531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:09.288654 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21736): Process ended prematurely: osmo-stp_10.42.42.5(pid=21736) [trial-2357↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21736)] [trial-2357↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 09:44:09.297790 tst handover.py:18: Test FAILED (6.7 sec) 09:44:09.326130 run osmo-hlr_10.42.42.2(pid=21733): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21733)] 09:44:09.376543 run osmo-hlr_10.42.42.2(pid=21733): stdout: | (launched: 2022-12-09_09:44:06.364618) 09:44:09.428516 run osmo-hlr_10.42.42.2(pid=21733): stderr: | [0;m[1;31m20221209094406558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094406558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094406558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094406558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094406558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094406558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094406570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094406579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094406579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094406579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:09.500259 run osmo-msc_10.42.42.6(pid=21739): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21739)] 09:44:09.550277 run osmo-msc_10.42.42.6(pid=21739): stdout: | (launched: 2022-12-09_09:44:08.350722) 09:44:09.601890 run osmo-msc_10.42.42.6(pid=21739): stderr: | [0;m[38;5;43m20221209094408667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094408667 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f08059a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094408667 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094408667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094408667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094408668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094408669 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094408670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094408670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094408670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:09.654273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21732): Terminating (SIGTERM) 09:44:09.696898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21735): Terminating (SIGTERM) 09:44:09.738989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21738): Terminating (SIGTERM) 09:44:09.781294 --- ParallelTerminationStrategy: PID 21732 died... 09:44:09.801191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21732): Terminated: ok {rc=0} 09:44:09.847779 --- ParallelTerminationStrategy: PID 21735 died... 09:44:09.867300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21735): Terminated: ok {rc=0} 09:44:09.913443 --- ParallelTerminationStrategy: PID 21738 died... 09:44:09.932942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21738): Terminated: ok {rc=0} 09:44:10.021416 bus /sierra_3: Setting Powered False 09:44:11.119696 bus /sierra_3: Setting Powered False 09:44:12.235523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 09:44:13.489840 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:13.496589 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:44:13.550017 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:44:13.578501 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:44:13.632418 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:44:13.684411 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:44:13.712804 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:44:14.265269 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 09:44:14.270938 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:14.282613 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:44:14.318348 tst handover.py: using LAC 20608 09:44:14.448122 tst handover.py: using RAC 208 09:44:14.575250 tst handover.py: using CellId 20608 09:44:14.697740 tst handover.py: using BVCI 20609 09:44:14.808143 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:44:14.857329 tst handover.py: using LAC 20609 09:44:14.978469 tst handover.py: using RAC 209 09:44:15.100249 tst handover.py: using CellId 20609 09:44:15.221178 tst handover.py: using BVCI 20610 09:44:15.332610 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.343818 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.354608 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.365513 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.376372 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.387204 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:44:15.506124 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:44:15.626550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:16.124830 run create_hlr_db(pid=21744): Launched 09:44:16.286822 bus /sierra_2: Setting Powered False 09:44:17.347533 run create_hlr_db(pid=21744): Terminated: ok {rc=0} 09:44:17.743724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21746): Launched 09:44:18.046165 run osmo-hlr_10.42.42.2(pid=21747): Launched 09:44:18.160894 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:18.654993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21749): Launched 09:44:18.957322 run osmo-stp_10.42.42.5(pid=21750): Launched 09:44:19.072749 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:19.594564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21752): Launched 09:44:19.898274 run osmo-msc_10.42.42.6(pid=21753): Launched 09:44:20.067850 run osmo-stp_10.42.42.5(pid=21750): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21750)] 09:44:20.196067 run osmo-stp_10.42.42.5(pid=21750): stdout: | (launched: 2022-12-09_09:44:18.901677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:20.324302 run osmo-stp_10.42.42.5(pid=21750): stderr: | [0;m[38;5;43m20221209094419067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094419067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094419067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094419068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094419068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094419068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094419068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:20.450775 run osmo-stp_10.42.42.5(pid=21750): stdout: | (launched: 2022-12-09_09:44:18.901677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:20.571619 run osmo-stp_10.42.42.5(pid=21750): stderr: | [0;m[38;5;43m20221209094419067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094419067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094419067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094419068 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094419068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094419068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094419068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:20.715760 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21750): Process ended prematurely: osmo-stp_10.42.42.5(pid=21750) [trial-2357↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21750)] [trial-2357↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 09:44:20.724039 tst handover.py:18: Test FAILED (6.4 sec) 09:44:20.749964 run osmo-hlr_10.42.42.2(pid=21747): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21747)] 09:44:20.797181 run osmo-hlr_10.42.42.2(pid=21747): stdout: | (launched: 2022-12-09_09:44:17.990608) 09:44:20.846098 run osmo-hlr_10.42.42.2(pid=21747): stderr: | [0;m[1;31m20221209094418165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094418165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094418165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094418165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094418165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094418165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094418177 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094418186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094418186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094418186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:20.913965 run osmo-msc_10.42.42.6(pid=21753): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21753)] 09:44:20.961110 run osmo-msc_10.42.42.6(pid=21753): stdout: | (launched: 2022-12-09_09:44:19.842449) 09:44:21.009764 run osmo-msc_10.42.42.6(pid=21753): stderr: | [0;m[38;5;43m20221209094420110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094420111 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc9b178c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094420111 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094420111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094420111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094420111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094420113 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094420113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094420113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094420114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:21.058760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21746): Terminating (SIGTERM) 09:44:21.098021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21749): Terminating (SIGTERM) 09:44:21.137518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21752): Terminating (SIGTERM) 09:44:21.177319 --- ParallelTerminationStrategy: PID 21746 died... 09:44:21.196262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21746): Terminated: ok {rc=0} 09:44:21.240049 --- ParallelTerminationStrategy: PID 21749 died... 09:44:21.258709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21749): Terminated: ok {rc=0} 09:44:21.302496 --- ParallelTerminationStrategy: PID 21752 died... 09:44:21.321087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21752): Terminated: ok {rc=0} 09:44:21.403839 bus /sierra_3: Setting Powered False 09:44:22.501613 bus /sierra_3: Setting Powered False 09:44:23.617614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 09:44:24.876319 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:24.881961 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:44:24.933310 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:44:24.961619 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:44:25.015323 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:44:25.066595 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:44:25.094916 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:44:25.647581 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 09:44:25.653387 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:25.664906 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:25.701217 tst handover.py: using LAC 20610 09:44:25.831490 tst handover.py: using RAC 210 09:44:25.961932 tst handover.py: using CellId 20610 09:44:26.089351 tst handover.py: using BVCI 20611 09:44:26.201343 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:26.248925 tst handover.py: using LAC 20611 09:44:26.366558 tst handover.py: using RAC 211 09:44:26.486840 tst handover.py: using CellId 20611 09:44:26.606623 tst handover.py: using BVCI 20612 09:44:26.717165 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:26.728214 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:26.739235 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:26.750494 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:26.761827 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:26.773047 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:26.893874 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:27.015723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:27.492902 run create_hlr_db(pid=21758): Launched 09:44:27.618102 bus /sierra_2: Setting Powered False 09:44:28.682427 run create_hlr_db(pid=21758): Terminated: ok {rc=0} 09:44:29.106816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21760): Launched 09:44:29.432660 run osmo-hlr_10.42.42.2(pid=21761): Launched 09:44:29.556399 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:30.087509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21763): Launched 09:44:30.411830 run osmo-stp_10.42.42.5(pid=21764): Launched 09:44:30.535402 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:31.115457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21766): Launched 09:44:31.488661 run osmo-msc_10.42.42.6(pid=21767): Launched 09:44:31.836760 run osmo-stp_10.42.42.5(pid=21764): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21764)] 09:44:32.110723 run osmo-stp_10.42.42.5(pid=21764): stdout: | (launched: 2022-12-09_09:44:30.352505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:32.309225 run osmo-stp_10.42.42.5(pid=21764): stderr: | [0;m[38;5;43m20221209094430542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094430542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094430542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094430543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094430543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094430543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094430543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:32.445876 run osmo-stp_10.42.42.5(pid=21764): stdout: | (launched: 2022-12-09_09:44:30.352505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:32.575445 run osmo-stp_10.42.42.5(pid=21764): stderr: | [0;m[38;5;43m20221209094430542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094430542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094430542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094430543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094430543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094430543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094430543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:32.730905 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21764): Process ended prematurely: osmo-stp_10.42.42.5(pid=21764) [trial-2357↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21764)] [trial-2357↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 09:44:32.739860 tst handover.py:18: Test FAILED (7.1 sec) 09:44:32.767693 run osmo-hlr_10.42.42.2(pid=21761): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21761)] 09:44:32.817878 run osmo-hlr_10.42.42.2(pid=21761): stdout: | (launched: 2022-12-09_09:44:29.373114) 09:44:32.869706 run osmo-hlr_10.42.42.2(pid=21761): stderr: | [0;m[1;31m20221209094429569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094429569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094429569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094429569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094429569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094429569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094429581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094429590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094429590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094429590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:32.941860 run osmo-msc_10.42.42.6(pid=21767): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21767)] 09:44:32.991974 run osmo-msc_10.42.42.6(pid=21767): stdout: | (launched: 2022-12-09_09:44:31.427889) 09:44:33.043847 run osmo-msc_10.42.42.6(pid=21767): stderr: | [0;m[38;5;43m20221209094432022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094432022 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f70dfa25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094432022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094432022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094432022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094432022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094432024 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094432024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094432025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094432025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:33.096065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21760): Terminating (SIGTERM) 09:44:33.138232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21763): Terminating (SIGTERM) 09:44:33.180192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21766): Terminating (SIGTERM) 09:44:33.222472 --- ParallelTerminationStrategy: PID 21760 died... 09:44:33.242552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21760): Terminated: ok {rc=0} 09:44:33.289258 --- ParallelTerminationStrategy: PID 21763 died... 09:44:33.308698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21763): Terminated: ok {rc=0} 09:44:33.355064 --- ParallelTerminationStrategy: PID 21766 died... 09:44:33.374627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21766): Terminated: ok {rc=0} 09:44:33.461977 bus /sierra_3: Setting Powered False 09:44:34.561119 bus /sierra_3: Setting Powered False 09:44:35.678216 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:44:36.944351 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:36.950002 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:44:37.011332 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:44:37.039331 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:44:37.091141 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:44:37.152678 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:44:37.180628 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:44:37.738588 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:44:37.744303 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:37.756024 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:44:37.805754 tst handover.py: using LAC 20612 09:44:37.933150 tst handover.py: using RAC 212 09:44:38.058362 tst handover.py: using CellId 20612 09:44:38.185346 tst handover.py: using BVCI 20613 09:44:38.303029 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:44:38.348191 tst handover.py: using LAC 20613 09:44:38.475651 tst handover.py: using RAC 213 09:44:38.601286 tst handover.py: using CellId 20613 09:44:38.727644 tst handover.py: using BVCI 20614 09:44:38.845641 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:38.857282 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:38.868691 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:38.880862 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:38.892590 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:44:38.904270 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:44:39.023797 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:44:39.144647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:39.621068 run create_hlr_db(pid=21772): Launched 09:44:39.745427 bus /sierra_2: Setting Powered False 09:44:40.805571 run create_hlr_db(pid=21772): Terminated: ok {rc=0} 09:44:41.220406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21774): Launched 09:44:41.545400 run osmo-hlr_10.42.42.2(pid=21775): Launched 09:44:41.670479 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:42.202787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21777): Launched 09:44:42.529053 run osmo-stp_10.42.42.5(pid=21778): Launched 09:44:42.654615 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:43.215399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21780): Launched 09:44:43.542878 run osmo-msc_10.42.42.6(pid=21781): Launched 09:44:43.725412 run osmo-stp_10.42.42.5(pid=21778): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21778)] 09:44:43.862679 run osmo-stp_10.42.42.5(pid=21778): stdout: | (launched: 2022-12-09_09:44:42.469622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:44.000416 run osmo-stp_10.42.42.5(pid=21778): stderr: | [0;m[38;5;43m20221209094442659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094442659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094442659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094442659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094442660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094442660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094442660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:44.136281 run osmo-stp_10.42.42.5(pid=21778): stdout: | (launched: 2022-12-09_09:44:42.469622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:44.265935 run osmo-stp_10.42.42.5(pid=21778): stderr: | [0;m[38;5;43m20221209094442659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094442659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094442659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094442659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094442660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094442660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094442660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:44.420642 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21778): Process ended prematurely: osmo-stp_10.42.42.5(pid=21778) [trial-2357↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21778)] [trial-2357↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 09:44:44.429798 tst handover.py:18: Test FAILED (6.7 sec) 09:44:44.457878 run osmo-hlr_10.42.42.2(pid=21775): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21775)] 09:44:44.507826 run osmo-hlr_10.42.42.2(pid=21775): stdout: | (launched: 2022-12-09_09:44:41.485930) 09:44:44.559556 run osmo-hlr_10.42.42.2(pid=21775): stderr: | [0;m[1;31m20221209094441679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094441679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094441679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094441679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094441679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094441679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094441692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094441700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094441700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094441701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:44.631842 run osmo-msc_10.42.42.6(pid=21781): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21781)] 09:44:44.681606 run osmo-msc_10.42.42.6(pid=21781): stdout: | (launched: 2022-12-09_09:44:43.482626) 09:44:44.733195 run osmo-msc_10.42.42.6(pid=21781): stderr: | [0;m[38;5;43m20221209094443802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094443802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdbe9f96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094443802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094443802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094443802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094443802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094443804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094443804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094443805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094443805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:44.785515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21774): Terminating (SIGTERM) 09:44:44.827158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21777): Terminating (SIGTERM) 09:44:44.868852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21780): Terminating (SIGTERM) 09:44:44.911545 --- ParallelTerminationStrategy: PID 21774 died... 09:44:44.931402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21774): Terminated: ok {rc=0} 09:44:44.978051 --- ParallelTerminationStrategy: PID 21777 died... 09:44:44.997612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21777): Terminated: ok {rc=0} 09:44:45.043984 --- ParallelTerminationStrategy: PID 21780 died... 09:44:45.063569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21780): Terminated: ok {rc=0} 09:44:45.151770 bus /sierra_3: Setting Powered False 09:44:46.270437 bus /sierra_3: Setting Powered False 09:44:47.405236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:44:48.677630 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:48.682824 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:44:48.746911 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:44:48.773948 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:44:48.827443 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:44:48.892908 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:44:48.919952 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:44:49.471019 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:44:49.476502 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:49.487804 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:44:49.540679 tst handover.py: using LAC 20614 09:44:49.660545 tst handover.py: using RAC 214 09:44:49.778336 tst handover.py: using CellId 20614 09:44:49.897439 tst handover.py: using BVCI 20615 09:44:50.009652 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:44:50.058035 tst handover.py: using LAC 20615 09:44:50.175314 tst handover.py: using RAC 215 09:44:50.302012 tst handover.py: using CellId 20615 09:44:50.428155 tst handover.py: using BVCI 20616 09:44:50.540063 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:50.551433 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:50.562676 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:50.574024 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:50.585325 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:44:50.596567 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:44:50.716389 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:44:50.836654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:51.284928 run create_hlr_db(pid=21786): Launched 09:44:51.408924 bus /sierra_2: Setting Powered False 09:44:52.469746 run create_hlr_db(pid=21786): Terminated: ok {rc=0} 09:44:52.868118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21788): Launched 09:44:53.171353 run osmo-hlr_10.42.42.2(pid=21789): Launched 09:44:53.286788 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:53.788270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21791): Launched 09:44:54.091867 run osmo-stp_10.42.42.5(pid=21792): Launched 09:44:54.206969 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:54.729274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21794): Launched 09:44:55.032795 run osmo-msc_10.42.42.6(pid=21795): Launched 09:44:55.202398 run osmo-stp_10.42.42.5(pid=21792): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21792)] 09:44:55.331459 run osmo-stp_10.42.42.5(pid=21792): stdout: | (launched: 2022-12-09_09:44:54.036055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:55.460072 run osmo-stp_10.42.42.5(pid=21792): stderr: | [0;m[38;5;43m20221209094454204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094454204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094454205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094454205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094454206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094454206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094454206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:55.586933 run osmo-stp_10.42.42.5(pid=21792): stdout: | (launched: 2022-12-09_09:44:54.036055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:55.708458 run osmo-stp_10.42.42.5(pid=21792): stderr: | [0;m[38;5;43m20221209094454204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094454204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094454205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094454205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094454206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094454206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094454206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:55.853405 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21792): Process ended prematurely: osmo-stp_10.42.42.5(pid=21792) [trial-2357↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21792)] [trial-2357↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 09:44:55.861806 tst handover.py:18: Test FAILED (6.4 sec) 09:44:55.888277 run osmo-hlr_10.42.42.2(pid=21789): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21789)] 09:44:55.936804 run osmo-hlr_10.42.42.2(pid=21789): stdout: | (launched: 2022-12-09_09:44:53.115674) 09:44:55.986809 run osmo-hlr_10.42.42.2(pid=21789): stderr: | [0;m[1;31m20221209094453287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094453287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094453287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094453287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094453287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094453287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094453299 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094453310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094453310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094453310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:56.056331 run osmo-msc_10.42.42.6(pid=21795): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21795)] 09:44:56.105170 run osmo-msc_10.42.42.6(pid=21795): stdout: | (launched: 2022-12-09_09:44:54.977125) 09:44:56.155060 run osmo-msc_10.42.42.6(pid=21795): stderr: | [0;m[38;5;43m20221209094455246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094455246 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7ed362c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094455246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094455246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094455247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094455247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094455248 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094455249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094455249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094455249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:56.205196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21788): Terminating (SIGTERM) 09:44:56.245320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21791): Terminating (SIGTERM) 09:44:56.285539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21794): Terminating (SIGTERM) 09:44:56.325990 --- ParallelTerminationStrategy: PID 21788 died... 09:44:56.345150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21788): Terminated: ok {rc=0} 09:44:56.389229 --- ParallelTerminationStrategy: PID 21791 died... 09:44:56.407905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21791): Terminated: ok {rc=0} 09:44:56.451679 --- ParallelTerminationStrategy: PID 21794 died... 09:44:56.470328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21794): Terminated: ok {rc=0} 09:44:56.554953 bus /sierra_3: Setting Powered False 09:44:57.654128 bus /sierra_3: Setting Powered False 09:44:58.767236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 09:45:00.046598 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:00.052125 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:45:00.105987 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:45:00.134316 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:45:00.187545 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:45:00.241320 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:45:00.269735 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:45:00.821044 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 09:45:00.830816 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:00.845756 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:45:00.905492 tst handover.py: using LAC 20616 09:45:01.041606 tst handover.py: using RAC 216 09:45:01.168660 tst handover.py: using CellId 20616 09:45:01.300461 tst handover.py: using BVCI 20617 09:45:01.437483 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:45:01.473290 tst handover.py: using LAC 20617 09:45:01.638439 tst handover.py: using RAC 217 09:45:01.776058 tst handover.py: using CellId 20617 09:45:01.909076 tst handover.py: using BVCI 20618 09:45:02.030997 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:02.043368 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:02.055671 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:02.069654 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:02.082835 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:02.095137 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:45:02.221620 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:45:02.374777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:02.856309 run create_hlr_db(pid=21803): Launched 09:45:02.981693 bus /sierra_2: Setting Powered False 09:45:04.046471 run create_hlr_db(pid=21803): Terminated: ok {rc=0} 09:45:04.469757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21805): Launched 09:45:04.795254 run osmo-hlr_10.42.42.2(pid=21806): Launched 09:45:04.919007 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:05.453253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21808): Launched 09:45:05.779695 run osmo-stp_10.42.42.5(pid=21809): Launched 09:45:05.903958 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:06.464218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21811): Launched 09:45:06.789838 run osmo-msc_10.42.42.6(pid=21812): Launched 09:45:06.971445 run osmo-stp_10.42.42.5(pid=21809): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21809)] 09:45:07.109405 run osmo-stp_10.42.42.5(pid=21809): stdout: | (launched: 2022-12-09_09:45:05.720266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:07.247945 run osmo-stp_10.42.42.5(pid=21809): stderr: | [0;m[38;5;43m20221209094505907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094505907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094505907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094505907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094505908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094505908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094505908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:07.384310 run osmo-stp_10.42.42.5(pid=21809): stdout: | (launched: 2022-12-09_09:45:05.720266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:07.515588 run osmo-stp_10.42.42.5(pid=21809): stderr: | [0;m[38;5;43m20221209094505907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094505907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094505907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094505907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094505908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094505908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094505908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:07.671342 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21809): Process ended prematurely: osmo-stp_10.42.42.5(pid=21809) [trial-2357↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21809)] [trial-2357↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 09:45:07.680376 tst handover.py:18: Test FAILED (6.8 sec) 09:45:07.709149 run osmo-hlr_10.42.42.2(pid=21806): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21806)] 09:45:07.759728 run osmo-hlr_10.42.42.2(pid=21806): stdout: | (launched: 2022-12-09_09:45:04.735830) 09:45:07.812189 run osmo-hlr_10.42.42.2(pid=21806): stderr: | [0;m[1;31m20221209094504928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094504928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094504928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094504928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094504928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094504928 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094504941 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094504950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094504950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094504950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:07.884708 run osmo-msc_10.42.42.6(pid=21812): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21812)] 09:45:07.934712 run osmo-msc_10.42.42.6(pid=21812): stdout: | (launched: 2022-12-09_09:45:06.730501) 09:45:07.986195 run osmo-msc_10.42.42.6(pid=21812): stderr: | [0;m[38;5;43m20221209094507047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094507047 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa9db436c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094507047 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094507047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094507047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094507048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094507049 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094507050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094507050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094507050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:08.038434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21805): Terminating (SIGTERM) 09:45:08.080149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21808): Terminating (SIGTERM) 09:45:08.122307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21811): Terminating (SIGTERM) 09:45:08.164580 --- ParallelTerminationStrategy: PID 21805 died... 09:45:08.184619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21805): Terminated: ok {rc=0} 09:45:08.231505 --- ParallelTerminationStrategy: PID 21808 died... 09:45:08.251185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21808): Terminated: ok {rc=0} 09:45:08.297921 --- ParallelTerminationStrategy: PID 21811 died... 09:45:08.317408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21811): Terminated: ok {rc=0} 09:45:08.404773 bus /sierra_3: Setting Powered False 09:45:09.504850 bus /sierra_3: Setting Powered False 09:45:10.620717 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 09:45:11.885206 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:11.890897 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:45:11.957216 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:45:11.985591 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:45:12.038996 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:45:12.105445 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:45:12.133600 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:45:12.682987 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 09:45:12.688312 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:12.699477 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:45:12.747304 tst handover.py: using LAC 20618 09:45:12.868273 tst handover.py: using RAC 218 09:45:12.988672 tst handover.py: using CellId 20618 09:45:13.109054 tst handover.py: using BVCI 20619 09:45:13.218299 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:45:13.267050 tst handover.py: using LAC 20619 09:45:13.387809 tst handover.py: using RAC 219 09:45:13.506401 tst handover.py: using CellId 20619 09:45:13.627325 tst handover.py: using BVCI 20620 09:45:13.739220 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:13.750258 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:13.761251 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:13.771994 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:13.782836 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:13.793516 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:45:13.912227 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:45:14.029611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:14.475409 run create_hlr_db(pid=21817): Launched 09:45:14.599739 bus /sierra_2: Setting Powered False 09:45:15.661201 run create_hlr_db(pid=21817): Terminated: ok {rc=0} 09:45:16.130844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21819): Launched 09:45:16.479361 run osmo-hlr_10.42.42.2(pid=21820): Launched 09:45:16.704536 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:17.337127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21822): Launched 09:45:17.664522 run osmo-stp_10.42.42.5(pid=21823): Launched 09:45:17.789979 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:18.352709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21825): Launched 09:45:18.679356 run osmo-msc_10.42.42.6(pid=21826): Launched 09:45:18.860926 run osmo-stp_10.42.42.5(pid=21823): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21823)] 09:45:18.998719 run osmo-stp_10.42.42.5(pid=21823): stdout: | (launched: 2022-12-09_09:45:17.604372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:19.137098 run osmo-stp_10.42.42.5(pid=21823): stderr: | [0;m[38;5;43m20221209094517794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094517795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094517795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094517795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094517796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094517796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094517796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:19.273310 run osmo-stp_10.42.42.5(pid=21823): stdout: | (launched: 2022-12-09_09:45:17.604372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:19.403436 run osmo-stp_10.42.42.5(pid=21823): stderr: | [0;m[38;5;43m20221209094517794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094517795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094517795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094517795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094517796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094517796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094517796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:19.559162 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21823): Process ended prematurely: osmo-stp_10.42.42.5(pid=21823) [trial-2357↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21823)] [trial-2357↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 09:45:19.568131 tst handover.py:18: Test FAILED (6.9 sec) 09:45:19.596925 run osmo-hlr_10.42.42.2(pid=21820): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21820)] 09:45:19.647475 run osmo-hlr_10.42.42.2(pid=21820): stdout: | (launched: 2022-12-09_09:45:16.415964) 09:45:19.699342 run osmo-hlr_10.42.42.2(pid=21820): stderr: | [0;m[1;31m20221209094516717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094516717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094516718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094516718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094516718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094516718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094516736 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094516750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094516753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094516754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:19.771176 run osmo-msc_10.42.42.6(pid=21826): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21826)] 09:45:19.821269 run osmo-msc_10.42.42.6(pid=21826): stdout: | (launched: 2022-12-09_09:45:18.619430) 09:45:19.873067 run osmo-msc_10.42.42.6(pid=21826): stderr: | [0;m[38;5;43m20221209094518937 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094518938 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9be1898c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094518938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094518938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094518938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094518938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094518940 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094518940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094518940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094518940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:19.925065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21819): Terminating (SIGTERM) 09:45:19.966596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21822): Terminating (SIGTERM) 09:45:20.008526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21825): Terminating (SIGTERM) 09:45:20.050918 --- ParallelTerminationStrategy: PID 21819 died... 09:45:20.070835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21819): Terminated: ok {rc=0} 09:45:20.118021 --- ParallelTerminationStrategy: PID 21822 died... 09:45:20.137802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21822): Terminated: ok {rc=0} 09:45:20.184692 --- ParallelTerminationStrategy: PID 21825 died... 09:45:20.204537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21825): Terminated: ok {rc=0} 09:45:20.293709 bus /sierra_3: Setting Powered False 09:45:21.392577 bus /sierra_3: Setting Powered False 09:45:22.509802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 09:45:23.787568 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:23.793387 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:45:23.859348 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:45:23.887633 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:45:23.941789 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:45:24.005520 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:45:24.032410 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:45:24.586924 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 09:45:24.592618 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:24.604323 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:45:24.653995 tst handover.py: using LAC 20620 09:45:24.783891 tst handover.py: using RAC 220 09:45:24.910718 tst handover.py: using CellId 20620 09:45:25.039197 tst handover.py: using BVCI 20621 09:45:25.157427 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:45:25.207044 tst handover.py: using LAC 20621 09:45:25.337356 tst handover.py: using RAC 221 09:45:25.465388 tst handover.py: using CellId 20621 09:45:25.590550 tst handover.py: using BVCI 20622 09:45:25.705554 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.716539 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.727270 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.738132 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.748841 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:25.759639 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:45:25.874432 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:45:25.995176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:26.472441 run create_hlr_db(pid=21831): Launched 09:45:26.596050 bus /sierra_2: Setting Powered False 09:45:27.656460 run create_hlr_db(pid=21831): Terminated: ok {rc=0} 09:45:28.072759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Launched 09:45:28.398599 run osmo-hlr_10.42.42.2(pid=21834): Launched 09:45:28.522873 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:29.053745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Launched 09:45:29.378790 run osmo-stp_10.42.42.5(pid=21837): Launched 09:45:29.502698 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:30.061730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21839): Launched 09:45:30.386140 run osmo-msc_10.42.42.6(pid=21840): Launched 09:45:30.567343 run osmo-stp_10.42.42.5(pid=21837): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] 09:45:30.705102 run osmo-stp_10.42.42.5(pid=21837): stdout: | (launched: 2022-12-09_09:45:29.319012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:30.843668 run osmo-stp_10.42.42.5(pid=21837): stderr: | [0;m[38;5;43m20221209094529506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094529506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094529506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094529507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094529507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094529507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094529507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:30.998487 run osmo-stp_10.42.42.5(pid=21837): stdout: | (launched: 2022-12-09_09:45:29.319012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:31.139075 run osmo-stp_10.42.42.5(pid=21837): stderr: | [0;m[38;5;43m20221209094529506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094529506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094529506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094529507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094529507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094529507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094529507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:31.343383 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21837): Process ended prematurely: osmo-stp_10.42.42.5(pid=21837) [trial-2357↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] [trial-2357↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 09:45:31.357984 tst handover.py:18: Test FAILED (6.8 sec) 09:45:31.397453 run osmo-hlr_10.42.42.2(pid=21834): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21834)] 09:45:31.460480 run osmo-hlr_10.42.42.2(pid=21834): stdout: | (launched: 2022-12-09_09:45:28.339478) 09:45:31.529362 run osmo-hlr_10.42.42.2(pid=21834): stderr: | [0;m[1;31m20221209094528532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094528532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094528532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094528532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094528533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094528533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094528545 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094528554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094528554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094528554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:31.621699 run osmo-msc_10.42.42.6(pid=21840): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21840)] 09:45:31.687348 run osmo-msc_10.42.42.6(pid=21840): stdout: | (launched: 2022-12-09_09:45:30.326915) 09:45:31.738965 run osmo-msc_10.42.42.6(pid=21840): stderr: | [0;m[38;5;43m20221209094530644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094530644 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff22b570c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094530644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094530644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094530644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094530644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094530646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094530646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094530647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094530647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:31.790659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Terminating (SIGTERM) 09:45:31.831920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Terminating (SIGTERM) 09:45:31.873689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21839): Terminating (SIGTERM) 09:45:31.919530 --- ParallelTerminationStrategy: PID 21833 died... 09:45:31.940863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Terminated: ok {rc=0} 09:45:31.987763 --- ParallelTerminationStrategy: PID 21836 died... 09:45:32.007553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Terminated: ok {rc=0} 09:45:32.053479 --- ParallelTerminationStrategy: PID 21839 died... 09:45:32.073185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21839): Terminated: ok {rc=0} 09:45:32.161486 bus /sierra_3: Setting Powered False 09:45:33.261187 bus /sierra_3: Setting Powered False 09:45:34.378960 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:45:35.656073 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:35.661637 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:45:35.724155 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:45:35.752064 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:45:35.806226 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:45:35.869337 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:45:35.897420 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:45:36.452316 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:45:36.457790 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:36.469542 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:45:36.515542 tst handover.py: using LAC 20622 09:45:36.644002 tst handover.py: using RAC 222 09:45:36.772714 tst handover.py: using CellId 20622 09:45:36.899418 tst handover.py: using BVCI 20623 09:45:37.017455 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:45:37.067833 tst handover.py: using LAC 20623 09:45:37.196291 tst handover.py: using RAC 223 09:45:37.324732 tst handover.py: using CellId 20623 09:45:37.446330 tst handover.py: using BVCI 20624 09:45:37.558991 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:37.570585 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:37.582159 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:37.594299 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:37.606308 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:45:37.618298 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:45:37.735606 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:45:37.855870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:38.331613 run create_hlr_db(pid=21846): Launched 09:45:38.457495 bus /sierra_2: Setting Powered False 09:45:39.521733 run create_hlr_db(pid=21846): Terminated: ok {rc=0} 09:45:39.945133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21848): Launched 09:45:40.272644 run osmo-hlr_10.42.42.2(pid=21849): Launched 09:45:40.397532 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:40.935631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21851): Launched 09:45:41.261667 run osmo-stp_10.42.42.5(pid=21852): Launched 09:45:41.385814 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:41.947549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21854): Launched 09:45:42.273742 run osmo-msc_10.42.42.6(pid=21855): Launched 09:45:42.455410 run osmo-stp_10.42.42.5(pid=21852): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21852)] 09:45:42.592864 run osmo-stp_10.42.42.5(pid=21852): stdout: | (launched: 2022-12-09_09:45:41.202468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:42.731387 run osmo-stp_10.42.42.5(pid=21852): stderr: | [0;m[38;5;43m20221209094541390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094541390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094541390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094541391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094541391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094541391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094541391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:42.867433 run osmo-stp_10.42.42.5(pid=21852): stdout: | (launched: 2022-12-09_09:45:41.202468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:42.997585 run osmo-stp_10.42.42.5(pid=21852): stderr: | [0;m[38;5;43m20221209094541390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094541390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094541390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094541391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094541391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094541391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094541391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:43.152563 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21852): Process ended prematurely: osmo-stp_10.42.42.5(pid=21852) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21852)] [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 09:45:43.161422 tst handover.py:18: Test FAILED (6.7 sec) 09:45:43.189679 run osmo-hlr_10.42.42.2(pid=21849): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21849)] 09:45:43.239853 run osmo-hlr_10.42.42.2(pid=21849): stdout: | (launched: 2022-12-09_09:45:40.213535) 09:45:43.291631 run osmo-hlr_10.42.42.2(pid=21849): stderr: | [0;m[1;31m20221209094540408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094540408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094540408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094540408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094540408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094540409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094540423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094540434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094540434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094540434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:43.364088 run osmo-msc_10.42.42.6(pid=21855): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21855)] 09:45:43.414038 run osmo-msc_10.42.42.6(pid=21855): stdout: | (launched: 2022-12-09_09:45:42.214463) 09:45:43.465729 run osmo-msc_10.42.42.6(pid=21855): stderr: | [0;m[38;5;43m20221209094542531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094542531 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfc0a8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094542531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094542531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094542531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094542532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094542533 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094542534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094542534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094542534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:43.518045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21848): Terminating (SIGTERM) 09:45:43.559756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21851): Terminating (SIGTERM) 09:45:43.601636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21854): Terminating (SIGTERM) 09:45:43.643799 --- ParallelTerminationStrategy: PID 21848 died... 09:45:43.663982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21848): Terminated: ok {rc=0} 09:45:43.710825 --- ParallelTerminationStrategy: PID 21851 died... 09:45:43.730368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21851): Terminated: ok {rc=0} 09:45:43.776811 --- ParallelTerminationStrategy: PID 21854 died... 09:45:43.796653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21854): Terminated: ok {rc=0} 09:45:43.883777 bus /sierra_3: Setting Powered False 09:45:44.981050 bus /sierra_3: Setting Powered False 09:45:46.094541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 09:45:47.388237 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:47.393682 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:45:47.443399 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:45:47.471527 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:45:47.525144 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:45:47.574162 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:45:47.602248 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:45:48.151763 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 09:45:48.157248 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:48.168546 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:45:48.212856 tst handover.py: using LAC 20624 09:45:48.333319 tst handover.py: using RAC 224 09:45:48.465408 tst handover.py: using CellId 20624 09:45:48.606726 tst handover.py: using BVCI 20625 09:45:48.727020 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:45:48.768655 tst handover.py: using LAC 20625 09:45:48.895817 tst handover.py: using RAC 225 09:45:49.022933 tst handover.py: using CellId 20625 09:45:49.148831 tst handover.py: using BVCI 20626 09:45:49.266916 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:49.278603 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:49.290183 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:49.302017 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:49.313726 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:45:49.325382 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:45:49.442743 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:45:49.562850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:50.039534 run create_hlr_db(pid=21861): Launched 09:45:50.163954 bus /sierra_2: Setting Powered False 09:45:51.228722 run create_hlr_db(pid=21861): Terminated: ok {rc=0} 09:45:51.652201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Launched 09:45:51.977306 run osmo-hlr_10.42.42.2(pid=21864): Launched 09:45:52.102208 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:52.631577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Launched 09:45:52.956664 run osmo-stp_10.42.42.5(pid=21867): Launched 09:45:53.080058 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:53.637100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21869): Launched 09:45:53.961460 run osmo-msc_10.42.42.6(pid=21870): Launched 09:45:54.144165 run osmo-stp_10.42.42.5(pid=21867): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] 09:45:54.281522 run osmo-stp_10.42.42.5(pid=21867): stdout: | (launched: 2022-12-09_09:45:52.897480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:54.419583 run osmo-stp_10.42.42.5(pid=21867): stderr: | [0;m[38;5;43m20221209094553084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094553084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094553084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094553085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094553085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094553085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094553085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:54.555369 run osmo-stp_10.42.42.5(pid=21867): stdout: | (launched: 2022-12-09_09:45:52.897480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:54.684773 run osmo-stp_10.42.42.5(pid=21867): stderr: | [0;m[38;5;43m20221209094553084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094553084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094553084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094553085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094553085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094553085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094553085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:54.839599 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21867): Process ended prematurely: osmo-stp_10.42.42.5(pid=21867) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 09:45:54.848345 tst handover.py:18: Test FAILED (6.7 sec) 09:45:54.876066 run osmo-hlr_10.42.42.2(pid=21864): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21864)] 09:45:54.925900 run osmo-hlr_10.42.42.2(pid=21864): stdout: | (launched: 2022-12-09_09:45:51.918035) 09:45:54.977764 run osmo-hlr_10.42.42.2(pid=21864): stderr: | [0;m[1;31m20221209094552111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094552111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094552111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094552111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094552111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094552111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094552123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094552132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094552132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094552132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:55.049710 run osmo-msc_10.42.42.6(pid=21870): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21870)] 09:45:55.099384 run osmo-msc_10.42.42.6(pid=21870): stdout: | (launched: 2022-12-09_09:45:53.902153) 09:45:55.150714 run osmo-msc_10.42.42.6(pid=21870): stderr: | [0;m[38;5;43m20221209094554220 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094554220 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb1ee1a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094554220 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094554220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094554220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094554220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094554222 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094554223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094554223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094554223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:55.202347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Terminating (SIGTERM) 09:45:55.243641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Terminating (SIGTERM) 09:45:55.285260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21869): Terminating (SIGTERM) 09:45:55.327211 --- ParallelTerminationStrategy: PID 21863 died... 09:45:55.346655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Terminated: ok {rc=0} 09:45:55.393305 --- ParallelTerminationStrategy: PID 21866 died... 09:45:55.413051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Terminated: ok {rc=0} 09:45:55.458880 --- ParallelTerminationStrategy: PID 21869 died... 09:45:55.478157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21869): Terminated: ok {rc=0} 09:45:55.565609 bus /sierra_3: Setting Powered False 09:45:56.663695 bus /sierra_3: Setting Powered False 09:45:57.781255 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 09:45:59.035901 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:59.041051 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:45:59.100729 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:45:59.127918 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:45:59.185683 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:45:59.245745 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:45:59.272563 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:45:59.821857 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 09:45:59.827196 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:45:59.838641 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:45:59.883671 tst handover.py: using LAC 20626 09:46:00.003024 tst handover.py: using RAC 226 09:46:00.121070 tst handover.py: using CellId 20626 09:46:00.238435 tst handover.py: using BVCI 20627 09:46:00.348071 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:46:00.395580 tst handover.py: using LAC 20627 09:46:00.522627 tst handover.py: using RAC 227 09:46:00.649888 tst handover.py: using CellId 20627 09:46:00.776523 tst handover.py: using BVCI 20628 09:46:00.900817 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:00.913454 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:00.926573 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:00.938740 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:00.951480 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:00.964335 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:01.104083 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:01.245594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:01.735487 run create_hlr_db(pid=21875): Launched 09:46:01.865736 bus /sierra_2: Setting Powered False 09:46:02.930457 run create_hlr_db(pid=21875): Terminated: ok {rc=0} 09:46:03.354713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Launched 09:46:03.680571 run osmo-hlr_10.42.42.2(pid=21878): Launched 09:46:03.805670 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:04.338822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Launched 09:46:04.663722 run osmo-stp_10.42.42.5(pid=21881): Launched 09:46:04.788106 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:05.349659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21883): Launched 09:46:05.674110 run osmo-msc_10.42.42.6(pid=21884): Launched 09:46:05.855604 run osmo-stp_10.42.42.5(pid=21881): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] 09:46:05.993433 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-09_09:46:04.604364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:06.131929 run osmo-stp_10.42.42.5(pid=21881): stderr: | [0;m[38;5;43m20221209094604793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094604793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094604794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094604794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094604795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094604795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094604795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:06.268074 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-09_09:46:04.604364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:06.397355 run osmo-stp_10.42.42.5(pid=21881): stderr: | [0;m[38;5;43m20221209094604793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094604793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094604794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094604794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094604795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094604795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094604795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:06.551800 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 09:46:06.560595 tst handover.py:18: Test FAILED (6.7 sec) 09:46:06.588197 run osmo-hlr_10.42.42.2(pid=21878): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21878)] 09:46:06.638095 run osmo-hlr_10.42.42.2(pid=21878): stdout: | (launched: 2022-12-09_09:46:03.620623) 09:46:06.689807 run osmo-hlr_10.42.42.2(pid=21878): stderr: | [0;m[1;31m20221209094603818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094603818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094603818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094603818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094603818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094603818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094603831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094603839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094603840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094603840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:06.761616 run osmo-msc_10.42.42.6(pid=21884): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21884)] 09:46:06.811235 run osmo-msc_10.42.42.6(pid=21884): stdout: | (launched: 2022-12-09_09:46:05.614449) 09:46:06.862515 run osmo-msc_10.42.42.6(pid=21884): stderr: | [0;m[38;5;43m20221209094605931 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094605931 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f389c6eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094605931 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094605932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094605932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094605932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094605934 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094605934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094605934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094605934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:06.914251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminating (SIGTERM) 09:46:06.955753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminating (SIGTERM) 09:46:06.997319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21883): Terminating (SIGTERM) 09:46:07.038980 --- ParallelTerminationStrategy: PID 21877 died... 09:46:07.058781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminated: ok {rc=0} 09:46:07.104746 --- ParallelTerminationStrategy: PID 21880 died... 09:46:07.124051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminated: ok {rc=0} 09:46:07.170177 --- ParallelTerminationStrategy: PID 21883 died... 09:46:07.189505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21883): Terminated: ok {rc=0} 09:46:07.276059 bus /sierra_3: Setting Powered False 09:46:08.374470 bus /sierra_3: Setting Powered False 09:46:09.490084 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 09:46:10.765994 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:10.771220 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:46:10.830773 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:46:10.857596 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:46:10.913606 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:46:10.972265 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:46:10.999150 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:46:11.549516 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 09:46:11.554608 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:11.565938 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:46:11.610025 tst handover.py: using LAC 20628 09:46:11.730495 tst handover.py: using RAC 228 09:46:11.849748 tst handover.py: using CellId 20628 09:46:11.967430 tst handover.py: using BVCI 20629 09:46:12.077214 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:46:12.124178 tst handover.py: using LAC 20629 09:46:12.243020 tst handover.py: using RAC 229 09:46:12.361791 tst handover.py: using CellId 20629 09:46:12.479387 tst handover.py: using BVCI 20630 09:46:12.590598 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:12.601918 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:12.612902 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:12.624035 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:12.635082 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:12.646128 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:46:12.767398 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:46:12.886954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:13.332754 run create_hlr_db(pid=21889): Launched 09:46:13.458011 bus /sierra_2: Setting Powered False 09:46:14.518611 run create_hlr_db(pid=21889): Terminated: ok {rc=0} 09:46:14.935284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21891): Launched 09:46:15.261455 run osmo-hlr_10.42.42.2(pid=21892): Launched 09:46:15.386950 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:15.937682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21894): Launched 09:46:16.285683 run osmo-stp_10.42.42.5(pid=21895): Launched 09:46:16.552405 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:17.150382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21897): Launched 09:46:17.482619 run osmo-msc_10.42.42.6(pid=21898): Launched 09:46:17.665558 run osmo-stp_10.42.42.5(pid=21895): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21895)] 09:46:17.803645 run osmo-stp_10.42.42.5(pid=21895): stdout: | (launched: 2022-12-09_09:46:16.215902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:17.942675 run osmo-stp_10.42.42.5(pid=21895): stderr: | [0;m[38;5;43m20221209094616451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094616451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094616452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094616452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094616453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094616453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094616453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:18.078428 run osmo-stp_10.42.42.5(pid=21895): stdout: | (launched: 2022-12-09_09:46:16.215902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:18.208046 run osmo-stp_10.42.42.5(pid=21895): stderr: | [0;m[38;5;43m20221209094616451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094616451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094616452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094616452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094616453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094616453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094616453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:18.363600 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21895): Process ended prematurely: osmo-stp_10.42.42.5(pid=21895) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21895)] [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 09:46:18.372708 tst handover.py:18: Test FAILED (6.8 sec) 09:46:18.400837 run osmo-hlr_10.42.42.2(pid=21892): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21892)] 09:46:18.451031 run osmo-hlr_10.42.42.2(pid=21892): stdout: | (launched: 2022-12-09_09:46:15.202080) 09:46:18.502919 run osmo-hlr_10.42.42.2(pid=21892): stderr: | [0;m[1;31m20221209094615395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094615395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094615395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094615395 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094615396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094615396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094615408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094615417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094615417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094615417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:18.575309 run osmo-msc_10.42.42.6(pid=21898): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21898)] 09:46:18.625463 run osmo-msc_10.42.42.6(pid=21898): stdout: | (launched: 2022-12-09_09:46:17.423412) 09:46:18.677569 run osmo-msc_10.42.42.6(pid=21898): stderr: | [0;m[38;5;43m20221209094617740 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094617740 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f435e8fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094617741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094617741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094617741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094617741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094617743 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094617743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094617743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094617743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:18.729832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21891): Terminating (SIGTERM) 09:46:18.771334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21894): Terminating (SIGTERM) 09:46:18.813023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21897): Terminating (SIGTERM) 09:46:18.855399 --- ParallelTerminationStrategy: PID 21891 died... 09:46:18.875308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21891): Terminated: ok {rc=0} 09:46:18.921849 --- ParallelTerminationStrategy: PID 21894 died... 09:46:18.941230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21894): Terminated: ok {rc=0} 09:46:18.987408 --- ParallelTerminationStrategy: PID 21897 died... 09:46:19.006925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21897): Terminated: ok {rc=0} 09:46:19.094874 bus /sierra_3: Setting Powered False 09:46:20.194434 bus /sierra_3: Setting Powered False 09:46:21.309919 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 09:46:22.586883 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:22.592794 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:46:22.647382 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:46:22.676223 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:46:22.731211 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:46:22.785119 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:46:22.813177 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:46:23.366812 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 09:46:23.372154 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:23.383754 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:46:23.434040 tst handover.py: using LAC 20630 09:46:23.560911 tst handover.py: using RAC 230 09:46:23.689328 tst handover.py: using CellId 20630 09:46:23.818776 tst handover.py: using BVCI 20631 09:46:23.929061 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:46:23.964940 tst handover.py: using LAC 20631 09:46:24.084244 tst handover.py: using RAC 231 09:46:24.214913 tst handover.py: using CellId 20631 09:46:24.342480 tst handover.py: using BVCI 20632 09:46:24.454728 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:24.466095 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:24.477179 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:24.488090 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:24.499367 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:46:24.510485 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:46:24.629382 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:46:24.751096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:25.228412 run create_hlr_db(pid=21903): Launched 09:46:25.353672 bus /sierra_2: Setting Powered False 09:46:26.417781 run create_hlr_db(pid=21903): Terminated: ok {rc=0} 09:46:26.842501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21905): Launched 09:46:27.169316 run osmo-hlr_10.42.42.2(pid=21906): Launched 09:46:27.294789 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:27.826733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21908): Launched 09:46:28.152050 run osmo-stp_10.42.42.5(pid=21909): Launched 09:46:28.276394 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:28.840872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21911): Launched 09:46:29.167125 run osmo-msc_10.42.42.6(pid=21912): Launched 09:46:29.349220 run osmo-stp_10.42.42.5(pid=21909): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21909)] 09:46:29.486923 run osmo-stp_10.42.42.5(pid=21909): stdout: | (launched: 2022-12-09_09:46:28.092612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:29.625161 run osmo-stp_10.42.42.5(pid=21909): stderr: | [0;m[38;5;43m20221209094628279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094628279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094628279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094628280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094628280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094628280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094628280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:29.761567 run osmo-stp_10.42.42.5(pid=21909): stdout: | (launched: 2022-12-09_09:46:28.092612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:29.890618 run osmo-stp_10.42.42.5(pid=21909): stderr: | [0;m[38;5;43m20221209094628279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094628279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094628279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094628280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094628280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094628280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094628280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:30.045378 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21909): Process ended prematurely: osmo-stp_10.42.42.5(pid=21909) [trial-2357↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21909)] [trial-2357↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 09:46:30.054287 tst handover.py:18: Test FAILED (6.7 sec) 09:46:30.082130 run osmo-hlr_10.42.42.2(pid=21906): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21906)] 09:46:30.131802 run osmo-hlr_10.42.42.2(pid=21906): stdout: | (launched: 2022-12-09_09:46:27.109730) 09:46:30.183324 run osmo-hlr_10.42.42.2(pid=21906): stderr: | [0;m[1;31m20221209094627304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094627304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094627304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094627304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094627304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094627304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094627316 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094627324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094627325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094627325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:30.255055 run osmo-msc_10.42.42.6(pid=21912): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21912)] 09:46:30.304705 run osmo-msc_10.42.42.6(pid=21912): stdout: | (launched: 2022-12-09_09:46:29.107400) 09:46:30.356246 run osmo-msc_10.42.42.6(pid=21912): stderr: | [0;m[38;5;43m20221209094629426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094629426 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8e433c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094629427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094629427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094629427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094629427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094629429 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094629429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094629429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094629429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:30.408404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21905): Terminating (SIGTERM) 09:46:30.450005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21908): Terminating (SIGTERM) 09:46:30.491611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21911): Terminating (SIGTERM) 09:46:30.533991 --- ParallelTerminationStrategy: PID 21905 died... 09:46:30.554044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21905): Terminated: ok {rc=0} 09:46:30.600822 --- ParallelTerminationStrategy: PID 21908 died... 09:46:30.620806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21908): Terminated: ok {rc=0} 09:46:30.667357 --- ParallelTerminationStrategy: PID 21911 died... 09:46:30.687246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21911): Terminated: ok {rc=0} 09:46:30.776689 bus /sierra_3: Setting Powered False 09:46:31.874957 bus /sierra_3: Setting Powered False 09:46:32.993435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 09:46:34.253830 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:34.259012 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:46:34.323436 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:46:34.350467 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:46:34.404661 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:46:34.474484 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:46:34.502522 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:46:35.047147 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 09:46:35.052251 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:35.063436 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:46:35.113582 tst handover.py: using LAC 20632 09:46:35.234191 tst handover.py: using RAC 232 09:46:35.354385 tst handover.py: using CellId 20632 09:46:35.473744 tst handover.py: using BVCI 20633 09:46:35.583761 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:46:35.633486 tst handover.py: using LAC 20633 09:46:35.754140 tst handover.py: using RAC 233 09:46:35.872701 tst handover.py: using CellId 20633 09:46:35.991530 tst handover.py: using BVCI 20634 09:46:36.102949 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:36.114158 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:36.125110 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:36.136072 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:36.147002 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:36.158020 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:36.276210 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:36.395481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:36.843329 run create_hlr_db(pid=21917): Launched 09:46:36.968835 bus /sierra_2: Setting Powered False 09:46:38.032857 run create_hlr_db(pid=21917): Terminated: ok {rc=0} 09:46:38.457289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21919): Launched 09:46:38.782737 run osmo-hlr_10.42.42.2(pid=21920): Launched 09:46:38.906819 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:39.437526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21922): Launched 09:46:39.762106 run osmo-stp_10.42.42.5(pid=21923): Launched 09:46:39.885807 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:40.443057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21925): Launched 09:46:40.768489 run osmo-msc_10.42.42.6(pid=21926): Launched 09:46:40.950847 run osmo-stp_10.42.42.5(pid=21923): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21923)] 09:46:41.088116 run osmo-stp_10.42.42.5(pid=21923): stdout: | (launched: 2022-12-09_09:46:39.702834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:41.226009 run osmo-stp_10.42.42.5(pid=21923): stderr: | [0;m[38;5;43m20221209094639891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094639891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094639891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094639892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094639892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094639892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094639892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:41.361518 run osmo-stp_10.42.42.5(pid=21923): stdout: | (launched: 2022-12-09_09:46:39.702834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:41.490848 run osmo-stp_10.42.42.5(pid=21923): stderr: | [0;m[38;5;43m20221209094639891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094639891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094639891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094639892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094639892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094639892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094639892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:41.645853 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21923): Process ended prematurely: osmo-stp_10.42.42.5(pid=21923) [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21923)] [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 09:46:41.654877 tst handover.py:18: Test FAILED (6.6 sec) 09:46:41.683162 run osmo-hlr_10.42.42.2(pid=21920): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21920)] 09:46:41.733237 run osmo-hlr_10.42.42.2(pid=21920): stdout: | (launched: 2022-12-09_09:46:38.723509) 09:46:41.784642 run osmo-hlr_10.42.42.2(pid=21920): stderr: | [0;m[1;31m20221209094638919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094638919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094638919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094638919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094638919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094638919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094638932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094638941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094638941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094638941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:41.856061 run osmo-msc_10.42.42.6(pid=21926): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21926)] 09:46:41.905704 run osmo-msc_10.42.42.6(pid=21926): stdout: | (launched: 2022-12-09_09:46:40.709018) 09:46:41.957078 run osmo-msc_10.42.42.6(pid=21926): stderr: | [0;m[38;5;43m20221209094641026 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094641026 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1b268ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094641026 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094641026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094641026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094641027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094641028 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094641029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094641029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094641029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:42.008810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21919): Terminating (SIGTERM) 09:46:42.050200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21922): Terminating (SIGTERM) 09:46:42.091742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21925): Terminating (SIGTERM) 09:46:42.133427 --- ParallelTerminationStrategy: PID 21919 died... 09:46:42.153148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21919): Terminated: ok {rc=0} 09:46:42.198966 --- ParallelTerminationStrategy: PID 21922 died... 09:46:42.218298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21922): Terminated: ok {rc=0} 09:46:42.263876 --- ParallelTerminationStrategy: PID 21925 died... 09:46:42.282967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21925): Terminated: ok {rc=0} 09:46:42.369990 bus /sierra_3: Setting Powered False 09:46:43.466664 bus /sierra_3: Setting Powered False 09:46:44.581468 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 09:46:45.868136 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:45.877690 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:46:45.970149 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:46:46.000028 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:46:46.059693 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:46:46.126415 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:46:46.154434 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:46:46.727283 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 09:46:46.735925 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:46.750524 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:46:46.809396 tst handover.py: using LAC 20634 09:46:46.968418 tst handover.py: using RAC 234 09:46:47.097965 tst handover.py: using CellId 20634 09:46:47.228799 tst handover.py: using BVCI 20635 09:46:47.352848 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:46:47.403158 tst handover.py: using LAC 20635 09:46:47.530639 tst handover.py: using RAC 235 09:46:47.657367 tst handover.py: using CellId 20635 09:46:47.785936 tst handover.py: using BVCI 20636 09:46:47.904355 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:47.915990 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:47.927492 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:47.939665 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:47.951793 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:46:47.964589 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:46:48.082304 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:46:48.203175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:46:48.679876 run create_hlr_db(pid=21931): Launched 09:46:48.804408 bus /sierra_2: Setting Powered False 09:46:49.868439 run create_hlr_db(pid=21931): Terminated: ok {rc=0} 09:46:50.276613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21933): Launched 09:46:50.581433 run osmo-hlr_10.42.42.2(pid=21934): Launched 09:46:50.696801 run osmo-stp_10.42.42.5: Starting osmo-stp 09:46:51.212098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21936): Launched 09:46:51.514600 run osmo-stp_10.42.42.5(pid=21937): Launched 09:46:51.630354 run osmo-msc_10.42.42.6: Starting osmo-msc 09:46:52.151691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21939): Launched 09:46:52.456638 run osmo-msc_10.42.42.6(pid=21940): Launched 09:46:52.627933 run osmo-stp_10.42.42.5(pid=21937): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21937)] 09:46:52.756252 run osmo-stp_10.42.42.5(pid=21937): stdout: | (launched: 2022-12-09_09:46:51.458707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:52.884391 run osmo-stp_10.42.42.5(pid=21937): stderr: | [0;m[38;5;43m20221209094651626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094651626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094651627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094651627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094651628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094651628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094651628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:53.010590 run osmo-stp_10.42.42.5(pid=21937): stdout: | (launched: 2022-12-09_09:46:51.458707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:46:53.131555 run osmo-stp_10.42.42.5(pid=21937): stderr: | [0;m[38;5;43m20221209094651626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094651626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094651627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094651627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094651628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094651628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094651628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:46:53.275773 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21937): Process ended prematurely: osmo-stp_10.42.42.5(pid=21937) [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21937)] [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 09:46:53.284205 tst handover.py:18: Test FAILED (6.5 sec) 09:46:53.310339 run osmo-hlr_10.42.42.2(pid=21934): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21934)] 09:46:53.357675 run osmo-hlr_10.42.42.2(pid=21934): stdout: | (launched: 2022-12-09_09:46:50.525509) 09:46:53.406735 run osmo-hlr_10.42.42.2(pid=21934): stderr: | [0;m[1;31m20221209094650699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094650699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094650699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094650699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094650699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094650699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094650710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094650718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094650718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094650719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:46:53.474972 run osmo-msc_10.42.42.6(pid=21940): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21940)] 09:46:53.522289 run osmo-msc_10.42.42.6(pid=21940): stdout: | (launched: 2022-12-09_09:46:52.400106) 09:46:53.571098 run osmo-msc_10.42.42.6(pid=21940): stderr: | [0;m[38;5;43m20221209094652668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094652668 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f167a41dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094652668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094652669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094652669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094652669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094652671 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094652671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094652671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094652671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:46:53.620446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21933): Terminating (SIGTERM) 09:46:53.660076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21936): Terminating (SIGTERM) 09:46:53.699679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21939): Terminating (SIGTERM) 09:46:53.739627 --- ParallelTerminationStrategy: PID 21933 died... 09:46:53.758726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21933): Terminated: ok {rc=0} 09:46:53.802616 --- ParallelTerminationStrategy: PID 21936 died... 09:46:53.821261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21936): Terminated: ok {rc=0} 09:46:53.864897 --- ParallelTerminationStrategy: PID 21939 died... 09:46:53.883901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21939): Terminated: ok {rc=0} 09:46:53.968924 bus /sierra_3: Setting Powered False 09:46:55.066931 bus /sierra_3: Setting Powered False 09:46:56.182330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 09:46:57.460739 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:46:57.466296 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:46:57.518775 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:46:57.546906 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:46:57.599447 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:46:57.650646 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:46:57.677555 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:46:58.233643 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 09:46:58.239046 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:58.250339 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:46:58.284849 tst handover.py: using LAC 20636 09:46:58.402254 tst handover.py: using RAC 236 09:46:58.519388 tst handover.py: using CellId 20636 09:46:58.638501 tst handover.py: using BVCI 20637 09:46:58.750160 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:46:58.797805 tst handover.py: using LAC 20637 09:46:58.925803 tst handover.py: using RAC 237 09:46:59.044266 tst handover.py: using CellId 20637 09:46:59.163201 tst handover.py: using BVCI 20638 09:46:59.275057 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:59.286256 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:59.297336 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:59.308480 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:59.319473 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:46:59.330387 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:59.444105 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:46:59.559662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:00.004887 run create_hlr_db(pid=21945): Launched 09:47:00.130930 bus /sierra_2: Setting Powered False 09:47:01.194350 run create_hlr_db(pid=21945): Terminated: ok {rc=0} 09:47:01.636373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21947): Launched 09:47:01.979176 run osmo-hlr_10.42.42.2(pid=21948): Launched 09:47:02.209961 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:02.711769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21950): Launched 09:47:03.015481 run osmo-stp_10.42.42.5(pid=21951): Launched 09:47:03.130870 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:03.656436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21953): Launched 09:47:03.960382 run osmo-msc_10.42.42.6(pid=21954): Launched 09:47:04.130053 run osmo-stp_10.42.42.5(pid=21951): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21951)] 09:47:04.271788 run osmo-stp_10.42.42.5(pid=21951): stdout: | (launched: 2022-12-09_09:47:02.959750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:04.400114 run osmo-stp_10.42.42.5(pid=21951): stderr: | [0;m[38;5;43m20221209094703126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094703126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094703127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094703127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094703128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094703128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094703128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:04.526326 run osmo-stp_10.42.42.5(pid=21951): stdout: | (launched: 2022-12-09_09:47:02.959750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:04.647717 run osmo-stp_10.42.42.5(pid=21951): stderr: | [0;m[38;5;43m20221209094703126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094703126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094703127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094703127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094703128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094703128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094703128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:04.791861 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21951): Process ended prematurely: osmo-stp_10.42.42.5(pid=21951) [trial-2357↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21951)] [trial-2357↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 09:47:04.800327 tst handover.py:18: Test FAILED (6.6 sec) 09:47:04.826647 run osmo-hlr_10.42.42.2(pid=21948): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21948)] 09:47:04.874455 run osmo-hlr_10.42.42.2(pid=21948): stdout: | (launched: 2022-12-09_09:47:01.916128) 09:47:04.923639 run osmo-hlr_10.42.42.2(pid=21948): stderr: | [0;m[1;31m20221209094702130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094702130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094702130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094702130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094702130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094702130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094702144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094702160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094702160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094702161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:04.992280 run osmo-msc_10.42.42.6(pid=21954): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21954)] 09:47:05.039751 run osmo-msc_10.42.42.6(pid=21954): stdout: | (launched: 2022-12-09_09:47:03.904398) 09:47:05.088403 run osmo-msc_10.42.42.6(pid=21954): stderr: | [0;m[38;5;43m20221209094704171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094704171 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0660512c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094704172 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094704172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094704172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094704172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094704174 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094704181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094704182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094704182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:05.138963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21947): Terminating (SIGTERM) 09:47:05.178583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21950): Terminating (SIGTERM) 09:47:05.218437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21953): Terminating (SIGTERM) 09:47:05.258389 --- ParallelTerminationStrategy: PID 21947 died... 09:47:05.277576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21947): Terminated: ok {rc=0} 09:47:05.322195 --- ParallelTerminationStrategy: PID 21950 died... 09:47:05.341121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21950): Terminated: ok {rc=0} 09:47:05.385331 --- ParallelTerminationStrategy: PID 21953 died... 09:47:05.404230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21953): Terminated: ok {rc=0} 09:47:05.489580 bus /sierra_3: Setting Powered False 09:47:06.589266 bus /sierra_3: Setting Powered False 09:47:07.704442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 09:47:08.970377 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:08.976665 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:47:09.027775 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:47:09.054822 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:47:09.106894 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:47:09.157557 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:47:09.184276 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:47:09.735011 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 09:47:09.740397 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:09.751677 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:47:09.789694 tst handover.py: using LAC 20638 09:47:09.917925 tst handover.py: using RAC 238 09:47:10.043727 tst handover.py: using CellId 20638 09:47:10.170570 tst handover.py: using BVCI 20639 09:47:10.288716 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:47:10.342562 tst handover.py: using LAC 20639 09:47:10.470009 tst handover.py: using RAC 239 09:47:10.595048 tst handover.py: using CellId 20639 09:47:10.722188 tst handover.py: using BVCI 20640 09:47:10.842310 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:10.853756 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:10.864886 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:10.876440 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:10.888041 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:10.899795 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:47:11.021271 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:47:11.144473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:11.623465 run create_hlr_db(pid=21959): Launched 09:47:11.748503 bus /sierra_2: Setting Powered False 09:47:12.813402 run create_hlr_db(pid=21959): Terminated: ok {rc=0} 09:47:13.237634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21961): Launched 09:47:13.563079 run osmo-hlr_10.42.42.2(pid=21962): Launched 09:47:13.686556 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:14.224675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21964): Launched 09:47:14.549862 run osmo-stp_10.42.42.5(pid=21965): Launched 09:47:14.674556 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:15.236230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21967): Launched 09:47:15.561236 run osmo-msc_10.42.42.6(pid=21968): Launched 09:47:15.742913 run osmo-stp_10.42.42.5(pid=21965): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21965)] 09:47:15.918725 run osmo-stp_10.42.42.5(pid=21965): stdout: | (launched: 2022-12-09_09:47:14.490193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:16.111945 run osmo-stp_10.42.42.5(pid=21965): stderr: | [0;m[38;5;43m20221209094714679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094714679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094714679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094714680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094714680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094714680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094714680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:16.284102 run osmo-stp_10.42.42.5(pid=21965): stdout: | (launched: 2022-12-09_09:47:14.490193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:16.427392 run osmo-stp_10.42.42.5(pid=21965): stderr: | [0;m[38;5;43m20221209094714679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094714679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094714679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094714680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094714680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094714680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094714680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:16.600701 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21965): Process ended prematurely: osmo-stp_10.42.42.5(pid=21965) [trial-2357↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21965)] [trial-2357↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 09:47:16.610387 tst handover.py:18: Test FAILED (6.9 sec) 09:47:16.640537 run osmo-hlr_10.42.42.2(pid=21962): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21962)] 09:47:16.692837 run osmo-hlr_10.42.42.2(pid=21962): stdout: | (launched: 2022-12-09_09:47:13.503459) 09:47:16.746705 run osmo-hlr_10.42.42.2(pid=21962): stderr: | [0;m[1;31m20221209094713698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094713698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094713698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094713698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094713698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094713698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094713711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094713720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094713720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094713720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:16.820898 run osmo-msc_10.42.42.6(pid=21968): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21968)] 09:47:16.873607 run osmo-msc_10.42.42.6(pid=21968): stdout: | (launched: 2022-12-09_09:47:15.501658) 09:47:16.926887 run osmo-msc_10.42.42.6(pid=21968): stderr: | [0;m[38;5;43m20221209094715821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094715821 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86ce0fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094715821 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094715821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094715821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094715822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094715830 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094715830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094715830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094715830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:16.980593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21961): Terminating (SIGTERM) 09:47:17.024044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21964): Terminating (SIGTERM) 09:47:17.067684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21967): Terminating (SIGTERM) 09:47:17.112055 --- ParallelTerminationStrategy: PID 21961 died... 09:47:17.132612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21961): Terminated: ok {rc=0} 09:47:17.181794 --- ParallelTerminationStrategy: PID 21964 died... 09:47:17.202042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21964): Terminated: ok {rc=0} 09:47:17.251692 --- ParallelTerminationStrategy: PID 21967 died... 09:47:17.271966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21967): Terminated: ok {rc=0} 09:47:17.363368 bus /sierra_3: Setting Powered False 09:47:18.462432 bus /sierra_3: Setting Powered False 09:47:19.578757 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2357 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 09:47:20.834911 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:47:20.840266 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:47:20.903497 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:47:20.930610 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:47:20.983327 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:47:21.046816 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:47:21.073757 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:47:21.625443 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2357 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 09:47:21.630546 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:21.641630 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:47:21.689274 tst handover.py: using LAC 20640 09:47:21.808666 tst handover.py: using RAC 240 09:47:21.929544 tst handover.py: using CellId 20640 09:47:22.058036 tst handover.py: using BVCI 20641 09:47:22.178897 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:47:22.228413 tst handover.py: using LAC 20641 09:47:22.364763 tst handover.py: using RAC 241 09:47:22.491362 tst handover.py: using CellId 20641 09:47:22.617206 tst handover.py: using BVCI 20642 09:47:22.735813 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:22.747398 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:22.759038 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:22.770761 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:22.782479 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:47:22.794191 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:47:22.916587 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:47:23.038444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:47:23.487741 run create_hlr_db(pid=21973): Launched 09:47:23.613968 bus /sierra_2: Setting Powered False 09:47:24.675024 run create_hlr_db(pid=21973): Terminated: ok {rc=0} 09:47:25.092868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21975): Launched 09:47:25.418430 run osmo-hlr_10.42.42.2(pid=21976): Launched 09:47:25.543452 run osmo-stp_10.42.42.5: Starting osmo-stp 09:47:26.078245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21978): Launched 09:47:26.402796 run osmo-stp_10.42.42.5(pid=21979): Launched 09:47:26.526969 run osmo-msc_10.42.42.6: Starting osmo-msc 09:47:27.088061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21981): Launched 09:47:27.412869 run osmo-msc_10.42.42.6(pid=21982): Launched 09:47:27.594534 run osmo-stp_10.42.42.5(pid=21979): ERR: Terminated: ERROR {rc=1} [trial-2357↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21979)] 09:47:27.732157 run osmo-stp_10.42.42.5(pid=21979): stdout: | (launched: 2022-12-09_09:47:26.343301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:27.869991 run osmo-stp_10.42.42.5(pid=21979): stderr: | [0;m[38;5;43m20221209094726530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094726531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094726531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094726531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094726532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094726532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094726532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:28.005545 run osmo-stp_10.42.42.5(pid=21979): stdout: | (launched: 2022-12-09_09:47:26.343301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:47:28.134871 run osmo-stp_10.42.42.5(pid=21979): stderr: | [0;m[38;5;43m20221209094726530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209094726531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209094726531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209094726531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209094726532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209094726532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209094726532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:47:28.289511 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=21979): Process ended prematurely: osmo-stp_10.42.42.5(pid=21979) [trial-2357↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21979)] [trial-2357↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 09:47:28.298503 tst handover.py:18: Test FAILED (6.7 sec) 09:47:28.326458 run osmo-hlr_10.42.42.2(pid=21976): ERR: Terminated: ERROR {rc=237} [trial-2357↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21976)] 09:47:28.377541 run osmo-hlr_10.42.42.2(pid=21976): stdout: | (launched: 2022-12-09_09:47:25.359214) 09:47:28.429668 run osmo-hlr_10.42.42.2(pid=21976): stderr: | [0;m[1;31m20221209094725552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209094725553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209094725553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209094725553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209094725553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209094725553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209094725565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209094725573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209094725573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209094725573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:47:28.501918 run osmo-msc_10.42.42.6(pid=21982): ERR: Terminated: ERROR {rc=2} [trial-2357↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21982)] 09:47:28.552081 run osmo-msc_10.42.42.6(pid=21982): stdout: | (launched: 2022-12-09_09:47:27.353720) 09:47:28.604029 run osmo-msc_10.42.42.6(pid=21982): stderr: | [0;m[38;5;43m20221209094727671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209094727671 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bb7dcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209094727671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209094727671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209094727671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209094727672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209094727673 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209094727674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209094727674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209094727674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:47:28.656447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21975): Terminating (SIGTERM) 09:47:28.698498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21978): Terminating (SIGTERM) 09:47:28.740820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21981): Terminating (SIGTERM) 09:47:28.783982 --- ParallelTerminationStrategy: PID 21975 died... 09:47:28.803925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21975): Terminated: ok {rc=0} 09:47:28.850828 --- ParallelTerminationStrategy: PID 21978 died... 09:47:28.870390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21978): Terminated: ok {rc=0} 09:47:28.916564 --- ParallelTerminationStrategy: PID 21981 died... 09:47:28.936079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21981): Terminated: ok {rc=0} 09:47:29.023522 bus /sierra_3: Setting Powered False 09:47:30.122852 bus /sierra_3: Setting Powered False 09:47:31.235714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2357 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 09:47:32.513434 tst trial-2357: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357/run.2022-12-09_08-22-41/trial-2357.xml -------------------------------------------------------------------------------------------- trial-2357 FAIL -------------------------------------------------------------------------------------------- 09:47:34.443384 tst trial-2357: trial-2357: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.7 sec) Error: osmo-nitb_10.42.42.2(pid=13236): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13236) [trial-2357↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13236)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (13.9 sec) Error: osmo-stp_10.42.42.5(pid=13250): Process ended prematurely: osmo-stp_10.42.42.5(pid=13250) [trial-2357↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13250)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13260): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13260) [trial-2357↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13260)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13270): Process ended prematurely: osmo-stp_10.42.42.5(pid=13270) [trial-2357↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13270)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13284): Process ended prematurely: osmo-stp_10.42.42.5(pid=13284) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13284)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13295): Process ended prematurely: osmo-stp_10.42.42.5(pid=13295) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13295)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13309): Process ended prematurely: osmo-stp_10.42.42.5(pid=13309) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13309)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13320): Process ended prematurely: osmo-stp_10.42.42.5(pid=13320) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13320)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13334): Process ended prematurely: osmo-stp_10.42.42.5(pid=13334) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13334)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13345): Process ended prematurely: osmo-stp_10.42.42.5(pid=13345) [trial-2357↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13345)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13360): Process ended prematurely: osmo-stp_10.42.42.5(pid=13360) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13360)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13371): Process ended prematurely: osmo-stp_10.42.42.5(pid=13371) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13371)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13385): Process ended prematurely: osmo-stp_10.42.42.5(pid=13385) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13385)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13396): Process ended prematurely: osmo-stp_10.42.42.5(pid=13396) [trial-2357↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13410): Process ended prematurely: osmo-stp_10.42.42.5(pid=13410) [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13410)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13422): Process ended prematurely: osmo-stp_10.42.42.5(pid=13422) [trial-2357↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13422)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13447): Process ended prematurely: osmo-stp_10.42.42.5(pid=13447) [trial-2357↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13447)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13461): Process ended prematurely: osmo-stp_10.42.42.5(pid=13461) [trial-2357↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13461)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13472): Process ended prematurely: osmo-stp_10.42.42.5(pid=13472) [trial-2357↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13472)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=13490): Process ended prematurely: osmo-stp_10.42.42.5(pid=13490) [trial-2357↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13490)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13502): Process ended prematurely: osmo-stp_10.42.42.5(pid=13502) [trial-2357↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13502)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13521): Process ended prematurely: osmo-stp_10.42.42.5(pid=13521) [trial-2357↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13521)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13531): Process ended prematurely: osmo-stp_10.42.42.5(pid=13531) [trial-2357↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13531)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13541): Process ended prematurely: osmo-stp_10.42.42.5(pid=13541) [trial-2357↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13541)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13560): Process ended prematurely: osmo-stp_10.42.42.5(pid=13560) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13560)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13572): Process ended prematurely: osmo-stp_10.42.42.5(pid=13572) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13572)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13593): Process ended prematurely: osmo-stp_10.42.42.5(pid=13593) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13593)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13603): Process ended prematurely: osmo-stp_10.42.42.5(pid=13603) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13603)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2357↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13631): Process ended prematurely: osmo-stp_10.42.42.5(pid=13631) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13631)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=13643): Process ended prematurely: osmo-stp_10.42.42.5(pid=13643) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13643)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=13661): Process ended prematurely: osmo-stp_10.42.42.5(pid=13661) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13661)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13671): Process ended prematurely: osmo-stp_10.42.42.5(pid=13671) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13671)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13681): Process ended prematurely: osmo-stp_10.42.42.5(pid=13681) [trial-2357↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13681)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13698): Process ended prematurely: osmo-stp_10.42.42.5(pid=13698) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13698)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=13710): Process ended prematurely: osmo-stp_10.42.42.5(pid=13710) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=13729): Process ended prematurely: osmo-stp_10.42.42.5(pid=13729) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13729)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13739): Process ended prematurely: osmo-stp_10.42.42.5(pid=13739) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13739)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13749): Process ended prematurely: osmo-stp_10.42.42.5(pid=13749) [trial-2357↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13749)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13767): Process ended prematurely: osmo-stp_10.42.42.5(pid=13767) [trial-2357↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13767)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13780): Process ended prematurely: osmo-stp_10.42.42.5(pid=13780) [trial-2357↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13780)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=13788): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13788) [trial-2357↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13788)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13799): Process ended prematurely: osmo-stp_10.42.42.5(pid=13799) [trial-2357↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13799)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=13808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13808) [trial-2357↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13808)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13818): Process ended prematurely: osmo-stp_10.42.42.5(pid=13818) [trial-2357↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13818)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13832): Process ended prematurely: osmo-stp_10.42.42.5(pid=13832) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13832)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13843): Process ended prematurely: osmo-stp_10.42.42.5(pid=13843) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13843)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13857): Process ended prematurely: osmo-stp_10.42.42.5(pid=13857) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13857)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13868): Process ended prematurely: osmo-stp_10.42.42.5(pid=13868) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13868)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13882): Process ended prematurely: osmo-stp_10.42.42.5(pid=13882) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13882)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13893): Process ended prematurely: osmo-stp_10.42.42.5(pid=13893) [trial-2357↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13908): Process ended prematurely: osmo-stp_10.42.42.5(pid=13908) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13908)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13919): Process ended prematurely: osmo-stp_10.42.42.5(pid=13919) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13919)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13943): Process ended prematurely: osmo-stp_10.42.42.5(pid=13943) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13943)] FAIL: mo_mt_call_osmux.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=14305): Process ended prematurely: osmo-stp_10.42.42.5(pid=14305) [trial-2357↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14305)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=14495): Process ended prematurely: osmo-stp_10.42.42.5(pid=14495) [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14495)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14507): Process ended prematurely: osmo-stp_10.42.42.5(pid=14507) [trial-2357↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14507)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14521): Process ended prematurely: osmo-stp_10.42.42.5(pid=14521) [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14521)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14532): Process ended prematurely: osmo-stp_10.42.42.5(pid=14532) [trial-2357↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14532)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14547): Process ended prematurely: osmo-stp_10.42.42.5(pid=14547) [trial-2357↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14547)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14558): Process ended prematurely: osmo-stp_10.42.42.5(pid=14558) [trial-2357↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14558)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=14576): Process ended prematurely: osmo-stp_10.42.42.5(pid=14576) [trial-2357↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14576)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=14588): Process ended prematurely: osmo-stp_10.42.42.5(pid=14588) [trial-2357↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14588)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=14606): Process ended prematurely: osmo-stp_10.42.42.5(pid=14606) [trial-2357↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=14616): Process ended prematurely: osmo-stp_10.42.42.5(pid=14616) [trial-2357↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14616)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14626): Process ended prematurely: osmo-stp_10.42.42.5(pid=14626) [trial-2357↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14626)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=14645): Process ended prematurely: osmo-stp_10.42.42.5(pid=14645) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14645)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=14657): Process ended prematurely: osmo-stp_10.42.42.5(pid=14657) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14657)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=14946): Process ended prematurely: osmo-stp_10.42.42.5(pid=14946) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14946)] FAIL: ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=14957): Process ended prematurely: osmo-stp_10.42.42.5(pid=14957) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14957)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14967): Process ended prematurely: osmo-stp_10.42.42.5(pid=14967) [trial-2357↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14967)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14984): Process ended prematurely: osmo-stp_10.42.42.5(pid=14984) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14984)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14996): Process ended prematurely: osmo-stp_10.42.42.5(pid=14996) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14996)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=15014): Process ended prematurely: osmo-stp_10.42.42.5(pid=15014) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15014)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15024): Process ended prematurely: osmo-stp_10.42.42.5(pid=15024) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15024)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15034): Process ended prematurely: osmo-stp_10.42.42.5(pid=15034) [trial-2357↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15034)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=15051): Process ended prematurely: osmo-stp_10.42.42.5(pid=15051) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15051)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=15064): Process ended prematurely: osmo-stp_10.42.42.5(pid=15064) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15064)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=15092): Process ended prematurely: osmo-stp_10.42.42.5(pid=15092) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15092)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15526): Process ended prematurely: osmo-stp_10.42.42.5(pid=15526) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15526)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15639): Process ended prematurely: osmo-stp_10.42.42.5(pid=15639) [trial-2357↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15639)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15653): Process ended prematurely: osmo-stp_10.42.42.5(pid=15653) [trial-2357↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15653)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15666): Process ended prematurely: osmo-stp_10.42.42.5(pid=15666) [trial-2357↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15666)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=15675): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15675) [trial-2357↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15675)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15685): Process ended prematurely: osmo-stp_10.42.42.5(pid=15685) [trial-2357↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15685)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=15695): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15695) [trial-2357↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15695)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=15705): Process ended prematurely: osmo-stp_10.42.42.5(pid=15705) [trial-2357↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15705)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15719): Process ended prematurely: osmo-stp_10.42.42.5(pid=15719) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15719)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15730): Process ended prematurely: osmo-stp_10.42.42.5(pid=15730) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15730)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15744): Process ended prematurely: osmo-stp_10.42.42.5(pid=15744) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15744)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15760): Process ended prematurely: osmo-stp_10.42.42.5(pid=15760) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15760)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15774): Process ended prematurely: osmo-stp_10.42.42.5(pid=15774) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15774)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15785): Process ended prematurely: osmo-stp_10.42.42.5(pid=15785) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15785)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15800): Process ended prematurely: osmo-stp_10.42.42.5(pid=15800) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15800)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15811): Process ended prematurely: osmo-stp_10.42.42.5(pid=15811) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15811)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15825): Process ended prematurely: osmo-stp_10.42.42.5(pid=15825) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15825)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15836): Process ended prematurely: osmo-stp_10.42.42.5(pid=15836) [trial-2357↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15836)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15850): Process ended prematurely: osmo-stp_10.42.42.5(pid=15850) [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15850)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15861): Process ended prematurely: osmo-stp_10.42.42.5(pid=15861) [trial-2357↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15861)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15875): Process ended prematurely: osmo-stp_10.42.42.5(pid=15875) [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15875)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15886): Process ended prematurely: osmo-stp_10.42.42.5(pid=15886) [trial-2357↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15886)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15900): Process ended prematurely: osmo-stp_10.42.42.5(pid=15900) [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15900)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15911): Process ended prematurely: osmo-stp_10.42.42.5(pid=15911) [trial-2357↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15911)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15925): Process ended prematurely: osmo-stp_10.42.42.5(pid=15925) [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15925)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15936): Process ended prematurely: osmo-stp_10.42.42.5(pid=15936) [trial-2357↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15936)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15950): Process ended prematurely: osmo-stp_10.42.42.5(pid=15950) [trial-2357↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15950)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15964): Process ended prematurely: osmo-stp_10.42.42.5(pid=15964) [trial-2357↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15964)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=15983): Process ended prematurely: osmo-stp_10.42.42.5(pid=15983) [trial-2357↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15983)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15995): Process ended prematurely: osmo-stp_10.42.42.5(pid=15995) [trial-2357↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15995)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=16013): Process ended prematurely: osmo-stp_10.42.42.5(pid=16013) [trial-2357↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16013)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16023): Process ended prematurely: osmo-stp_10.42.42.5(pid=16023) [trial-2357↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16033): Process ended prematurely: osmo-stp_10.42.42.5(pid=16033) [trial-2357↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16033)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=16050): Process ended prematurely: osmo-stp_10.42.42.5(pid=16050) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16050)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16062): Process ended prematurely: osmo-stp_10.42.42.5(pid=16062) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16062)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=16080): Process ended prematurely: osmo-stp_10.42.42.5(pid=16080) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16080)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16091): Process ended prematurely: osmo-stp_10.42.42.5(pid=16091) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16091)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16101): Process ended prematurely: osmo-stp_10.42.42.5(pid=16101) [trial-2357↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16101)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=16119): Process ended prematurely: osmo-stp_10.42.42.5(pid=16119) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16119)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16131): Process ended prematurely: osmo-stp_10.42.42.5(pid=16131) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=16150): Process ended prematurely: osmo-stp_10.42.42.5(pid=16150) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16150)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16160): Process ended prematurely: osmo-stp_10.42.42.5(pid=16160) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16160)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16171): Process ended prematurely: osmo-stp_10.42.42.5(pid=16171) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=16188): Process ended prematurely: osmo-stp_10.42.42.5(pid=16188) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16188)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=16200): Process ended prematurely: osmo-stp_10.42.42.5(pid=16200) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16200)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=16218): Process ended prematurely: osmo-stp_10.42.42.5(pid=16218) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16218)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16228): Process ended prematurely: osmo-stp_10.42.42.5(pid=16228) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16228)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16238): Process ended prematurely: osmo-stp_10.42.42.5(pid=16238) [trial-2357↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16238)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=16256): Process ended prematurely: osmo-stp_10.42.42.5(pid=16256) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16256)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=16269): Process ended prematurely: osmo-stp_10.42.42.5(pid=16269) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16269)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=16287): Process ended prematurely: osmo-stp_10.42.42.5(pid=16287) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16307): Process ended prematurely: osmo-stp_10.42.42.5(pid=16307) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16307)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16667): Process ended prematurely: osmo-stp_10.42.42.5(pid=16667) [trial-2357↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16667)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=16858): Process ended prematurely: osmo-stp_10.42.42.5(pid=16858) [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16858)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16872): Process ended prematurely: osmo-stp_10.42.42.5(pid=16872) [trial-2357↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16872)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=16880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16880) [trial-2357↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16880)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16890): Process ended prematurely: osmo-stp_10.42.42.5(pid=16890) [trial-2357↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16890)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=16899): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16899) [trial-2357↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16899)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16909): Process ended prematurely: osmo-stp_10.42.42.5(pid=16909) [trial-2357↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16909)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16923): Process ended prematurely: osmo-stp_10.42.42.5(pid=16923) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16923)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16934): Process ended prematurely: osmo-stp_10.42.42.5(pid=16934) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16934)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16948): Process ended prematurely: osmo-stp_10.42.42.5(pid=16948) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16948)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16959): Process ended prematurely: osmo-stp_10.42.42.5(pid=16959) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16959)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16973): Process ended prematurely: osmo-stp_10.42.42.5(pid=16973) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16973)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16984): Process ended prematurely: osmo-stp_10.42.42.5(pid=16984) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16984)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16998): Process ended prematurely: osmo-stp_10.42.42.5(pid=16998) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16998)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17012): Process ended prematurely: osmo-stp_10.42.42.5(pid=17012) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17012)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17026): Process ended prematurely: osmo-stp_10.42.42.5(pid=17026) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17026)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17037): Process ended prematurely: osmo-stp_10.42.42.5(pid=17037) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17037)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=17323): Process ended prematurely: osmo-stp_10.42.42.5(pid=17323) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17323)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17334): Process ended prematurely: osmo-stp_10.42.42.5(pid=17334) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17334)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17349): Process ended prematurely: osmo-stp_10.42.42.5(pid=17349) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17349)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17360): Process ended prematurely: osmo-stp_10.42.42.5(pid=17360) [trial-2357↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17360)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17374): Process ended prematurely: osmo-stp_10.42.42.5(pid=17374) [trial-2357↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17374)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17385): Process ended prematurely: osmo-stp_10.42.42.5(pid=17385) [trial-2357↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17385)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=17403): Process ended prematurely: osmo-stp_10.42.42.5(pid=17403) [trial-2357↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17403)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=17415): Process ended prematurely: osmo-stp_10.42.42.5(pid=17415) [trial-2357↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17415)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=17433): Process ended prematurely: osmo-stp_10.42.42.5(pid=17433) [trial-2357↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17433)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17446): Process ended prematurely: osmo-stp_10.42.42.5(pid=17446) [trial-2357↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17446)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17456): Process ended prematurely: osmo-stp_10.42.42.5(pid=17456) [trial-2357↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17456)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=17474): Process ended prematurely: osmo-stp_10.42.42.5(pid=17474) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17474)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17487): Process ended prematurely: osmo-stp_10.42.42.5(pid=17487) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17487)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=17505): Process ended prematurely: osmo-stp_10.42.42.5(pid=17505) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17505)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17515): Process ended prematurely: osmo-stp_10.42.42.5(pid=17515) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17515)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17525): Process ended prematurely: osmo-stp_10.42.42.5(pid=17525) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17525)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17543): Process ended prematurely: osmo-stp_10.42.42.5(pid=17543) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17543)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17555): Process ended prematurely: osmo-stp_10.42.42.5(pid=17555) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17555)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=17573): Process ended prematurely: osmo-stp_10.42.42.5(pid=17573) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17573)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17583): Process ended prematurely: osmo-stp_10.42.42.5(pid=17583) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17583)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17593): Process ended prematurely: osmo-stp_10.42.42.5(pid=17593) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17593)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=17613): Process ended prematurely: osmo-stp_10.42.42.5(pid=17613) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17613)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17625): Process ended prematurely: osmo-stp_10.42.42.5(pid=17625) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17625)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=17645): Process ended prematurely: osmo-stp_10.42.42.5(pid=17645) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17645)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17655): Process ended prematurely: osmo-stp_10.42.42.5(pid=17655) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17655)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17665): Process ended prematurely: osmo-stp_10.42.42.5(pid=17665) [trial-2357↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17665)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17678): Process ended prematurely: osmo-stp_10.42.42.5(pid=17678) [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17678)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17692): Process ended prematurely: osmo-stp_10.42.42.5(pid=17692) [trial-2357↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17692)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17701): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17701) [trial-2357↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17701)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17711): Process ended prematurely: osmo-stp_10.42.42.5(pid=17711) [trial-2357↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17711)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17720): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17720) [trial-2357↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17720)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=17730): Process ended prematurely: osmo-stp_10.42.42.5(pid=17730) [trial-2357↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17730)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17744): Process ended prematurely: osmo-stp_10.42.42.5(pid=17744) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17755): Process ended prematurely: osmo-stp_10.42.42.5(pid=17755) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17755)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17769): Process ended prematurely: osmo-stp_10.42.42.5(pid=17769) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17769)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17780): Process ended prematurely: osmo-stp_10.42.42.5(pid=17780) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17780)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17794): Process ended prematurely: osmo-stp_10.42.42.5(pid=17794) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17794)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17849): Process ended prematurely: osmo-stp_10.42.42.5(pid=17849) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17849)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17864): Process ended prematurely: osmo-stp_10.42.42.5(pid=17864) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17864)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17875): Process ended prematurely: osmo-stp_10.42.42.5(pid=17875) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17875)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17892): Process ended prematurely: osmo-stp_10.42.42.5(pid=17892) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17892)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17903): Process ended prematurely: osmo-stp_10.42.42.5(pid=17903) [trial-2357↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17903)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17917): Process ended prematurely: osmo-stp_10.42.42.5(pid=17917) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17917)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17928): Process ended prematurely: osmo-stp_10.42.42.5(pid=17928) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17928)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17942): Process ended prematurely: osmo-stp_10.42.42.5(pid=17942) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17942)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17953): Process ended prematurely: osmo-stp_10.42.42.5(pid=17953) [trial-2357↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17953)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17967): Process ended prematurely: osmo-stp_10.42.42.5(pid=17967) [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17967)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17978): Process ended prematurely: osmo-stp_10.42.42.5(pid=17978) [trial-2357↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17978)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17992): Process ended prematurely: osmo-stp_10.42.42.5(pid=17992) [trial-2357↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17992)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18003): Process ended prematurely: osmo-stp_10.42.42.5(pid=18003) [trial-2357↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18003)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18024): Process ended prematurely: osmo-stp_10.42.42.5(pid=18024) [trial-2357↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18024)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18036): Process ended prematurely: osmo-stp_10.42.42.5(pid=18036) [trial-2357↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18036)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=18055): Process ended prematurely: osmo-stp_10.42.42.5(pid=18055) [trial-2357↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18055)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18065): Process ended prematurely: osmo-stp_10.42.42.5(pid=18065) [trial-2357↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18065)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18075): Process ended prematurely: osmo-stp_10.42.42.5(pid=18075) [trial-2357↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18075)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=18092): Process ended prematurely: osmo-stp_10.42.42.5(pid=18092) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18092)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=18104): Process ended prematurely: osmo-stp_10.42.42.5(pid=18104) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18104)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18122): Process ended prematurely: osmo-stp_10.42.42.5(pid=18122) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18122)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18132): Process ended prematurely: osmo-stp_10.42.42.5(pid=18132) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18142): Process ended prematurely: osmo-stp_10.42.42.5(pid=18142) [trial-2357↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18142)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18162): Process ended prematurely: osmo-stp_10.42.42.5(pid=18162) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18162)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18174): Process ended prematurely: osmo-stp_10.42.42.5(pid=18174) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18174)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=18195): Process ended prematurely: osmo-stp_10.42.42.5(pid=18195) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18195)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18205): Process ended prematurely: osmo-stp_10.42.42.5(pid=18205) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18205)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18215): Process ended prematurely: osmo-stp_10.42.42.5(pid=18215) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18215)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18232): Process ended prematurely: osmo-stp_10.42.42.5(pid=18232) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18232)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=18244): Process ended prematurely: osmo-stp_10.42.42.5(pid=18244) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18244)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18263): Process ended prematurely: osmo-stp_10.42.42.5(pid=18263) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18263)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18273): Process ended prematurely: osmo-stp_10.42.42.5(pid=18273) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18273)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18285): Process ended prematurely: osmo-stp_10.42.42.5(pid=18285) [trial-2357↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18285)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=18303): Process ended prematurely: osmo-stp_10.42.42.5(pid=18303) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18303)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=18315): Process ended prematurely: osmo-stp_10.42.42.5(pid=18315) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18333): Process ended prematurely: osmo-stp_10.42.42.5(pid=18333) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18333)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18343): Process ended prematurely: osmo-stp_10.42.42.5(pid=18343) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18343)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18353): Process ended prematurely: osmo-stp_10.42.42.5(pid=18353) [trial-2357↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18353)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18367): Process ended prematurely: osmo-stp_10.42.42.5(pid=18367) [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18367)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18380): Process ended prematurely: osmo-stp_10.42.42.5(pid=18380) [trial-2357↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18380)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18388): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18388) [trial-2357↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18388)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=18669): Process ended prematurely: osmo-stp_10.42.42.5(pid=18669) [trial-2357↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18669)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18678): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18678) [trial-2357↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18678)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18689): Process ended prematurely: osmo-stp_10.42.42.5(pid=18689) [trial-2357↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18689)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18703): Process ended prematurely: osmo-stp_10.42.42.5(pid=18703) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18703)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18714): Process ended prematurely: osmo-stp_10.42.42.5(pid=18714) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18714)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18728): Process ended prematurely: osmo-stp_10.42.42.5(pid=18728) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18728)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18739): Process ended prematurely: osmo-stp_10.42.42.5(pid=18739) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18739)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18753): Process ended prematurely: osmo-stp_10.42.42.5(pid=18753) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18753)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18764): Process ended prematurely: osmo-stp_10.42.42.5(pid=18764) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18764)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18778): Process ended prematurely: osmo-stp_10.42.42.5(pid=18778) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18778)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18790): Process ended prematurely: osmo-stp_10.42.42.5(pid=18790) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18790)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18804): Process ended prematurely: osmo-stp_10.42.42.5(pid=18804) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18804)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18818): Process ended prematurely: osmo-stp_10.42.42.5(pid=18818) [trial-2357↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18818)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18832): Process ended prematurely: osmo-stp_10.42.42.5(pid=18832) [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18832)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18843): Process ended prematurely: osmo-stp_10.42.42.5(pid=18843) [trial-2357↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18843)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18860): Process ended prematurely: osmo-stp_10.42.42.5(pid=18860) [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18860)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18871): Process ended prematurely: osmo-stp_10.42.42.5(pid=18871) [trial-2357↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18871)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18885): Process ended prematurely: osmo-stp_10.42.42.5(pid=18885) [trial-2357↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18885)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18897): Process ended prematurely: osmo-stp_10.42.42.5(pid=18897) [trial-2357↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18897)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18915): Process ended prematurely: osmo-stp_10.42.42.5(pid=18915) [trial-2357↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18915)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18927): Process ended prematurely: osmo-stp_10.42.42.5(pid=18927) [trial-2357↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18927)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=18945): Process ended prematurely: osmo-stp_10.42.42.5(pid=18945) [trial-2357↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18945)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18955): Process ended prematurely: osmo-stp_10.42.42.5(pid=18955) [trial-2357↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18955)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18965): Process ended prematurely: osmo-stp_10.42.42.5(pid=18965) [trial-2357↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18965)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=18983): Process ended prematurely: osmo-stp_10.42.42.5(pid=18983) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18983)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19000): Process ended prematurely: osmo-stp_10.42.42.5(pid=19000) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19000)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19018): Process ended prematurely: osmo-stp_10.42.42.5(pid=19018) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19018)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19028): Process ended prematurely: osmo-stp_10.42.42.5(pid=19028) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19028)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19038): Process ended prematurely: osmo-stp_10.42.42.5(pid=19038) [trial-2357↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19038)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19055): Process ended prematurely: osmo-stp_10.42.42.5(pid=19055) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19055)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=19067): Process ended prematurely: osmo-stp_10.42.42.5(pid=19067) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19067)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=19085): Process ended prematurely: osmo-stp_10.42.42.5(pid=19085) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19085)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19095): Process ended prematurely: osmo-stp_10.42.42.5(pid=19095) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19095)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19105): Process ended prematurely: osmo-stp_10.42.42.5(pid=19105) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19105)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19122): Process ended prematurely: osmo-stp_10.42.42.5(pid=19122) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19122)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19134): Process ended prematurely: osmo-stp_10.42.42.5(pid=19134) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19134)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19152): Process ended prematurely: osmo-stp_10.42.42.5(pid=19152) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19152)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19165): Process ended prematurely: osmo-stp_10.42.42.5(pid=19165) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19165)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19175): Process ended prematurely: osmo-stp_10.42.42.5(pid=19175) [trial-2357↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19175)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19191): Process ended prematurely: osmo-stp_10.42.42.5(pid=19191) [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19191)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19204): Process ended prematurely: osmo-stp_10.42.42.5(pid=19204) [trial-2357↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19204)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=19213): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19213) [trial-2357↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19213)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19223): Process ended prematurely: osmo-stp_10.42.42.5(pid=19223) [trial-2357↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19223)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19232): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19232) [trial-2357↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19232)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19243): Process ended prematurely: osmo-stp_10.42.42.5(pid=19243) [trial-2357↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19243)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19257): Process ended prematurely: osmo-stp_10.42.42.5(pid=19257) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19257)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19268): Process ended prematurely: osmo-stp_10.42.42.5(pid=19268) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19268)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19282): Process ended prematurely: osmo-stp_10.42.42.5(pid=19282) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19282)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19293): Process ended prematurely: osmo-stp_10.42.42.5(pid=19293) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19293)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19310): Process ended prematurely: osmo-stp_10.42.42.5(pid=19310) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19310)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19321): Process ended prematurely: osmo-stp_10.42.42.5(pid=19321) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19321)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19335): Process ended prematurely: osmo-stp_10.42.42.5(pid=19335) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19335)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19346): Process ended prematurely: osmo-stp_10.42.42.5(pid=19346) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19346)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19360): Process ended prematurely: osmo-stp_10.42.42.5(pid=19360) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19360)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19371): Process ended prematurely: osmo-stp_10.42.42.5(pid=19371) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19371)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19385): Process ended prematurely: osmo-stp_10.42.42.5(pid=19385) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19385)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19396): Process ended prematurely: osmo-stp_10.42.42.5(pid=19396) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19396)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19410): Process ended prematurely: osmo-stp_10.42.42.5(pid=19410) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19410)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19421): Process ended prematurely: osmo-stp_10.42.42.5(pid=19421) [trial-2357↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19421)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19436): Process ended prematurely: osmo-stp_10.42.42.5(pid=19436) [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19436)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19447): Process ended prematurely: osmo-stp_10.42.42.5(pid=19447) [trial-2357↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19447)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19465): Process ended prematurely: osmo-stp_10.42.42.5(pid=19465) [trial-2357↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19465)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=19477): Process ended prematurely: osmo-stp_10.42.42.5(pid=19477) [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19477)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19495): Process ended prematurely: osmo-stp_10.42.42.5(pid=19495) [trial-2357↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19495)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19508): Process ended prematurely: osmo-stp_10.42.42.5(pid=19508) [trial-2357↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19508)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19518): Process ended prematurely: osmo-stp_10.42.42.5(pid=19518) [trial-2357↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19518)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=19535): Process ended prematurely: osmo-stp_10.42.42.5(pid=19535) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19535)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19547): Process ended prematurely: osmo-stp_10.42.42.5(pid=19547) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19547)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19565): Process ended prematurely: osmo-stp_10.42.42.5(pid=19565) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19565)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19575): Process ended prematurely: osmo-stp_10.42.42.5(pid=19575) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19575)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19585): Process ended prematurely: osmo-stp_10.42.42.5(pid=19585) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19585)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=19603): Process ended prematurely: osmo-stp_10.42.42.5(pid=19603) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19603)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=19617): Process ended prematurely: osmo-stp_10.42.42.5(pid=19617) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19617)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19635): Process ended prematurely: osmo-stp_10.42.42.5(pid=19635) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19635)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19645): Process ended prematurely: osmo-stp_10.42.42.5(pid=19645) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19645)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19655): Process ended prematurely: osmo-stp_10.42.42.5(pid=19655) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19655)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=19673): Process ended prematurely: osmo-stp_10.42.42.5(pid=19673) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19673)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=19690): Process ended prematurely: osmo-stp_10.42.42.5(pid=19690) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19690)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=19708): Process ended prematurely: osmo-stp_10.42.42.5(pid=19708) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19708)] FAIL: ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19998): Process ended prematurely: osmo-stp_10.42.42.5(pid=19998) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19998)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20008): Process ended prematurely: osmo-stp_10.42.42.5(pid=20008) [trial-2357↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20008)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=20021): Process ended prematurely: osmo-stp_10.42.42.5(pid=20021) [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20021)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20034): Process ended prematurely: osmo-stp_10.42.42.5(pid=20034) [trial-2357↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20034)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20043): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20043) [trial-2357↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20043)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20054): Process ended prematurely: osmo-stp_10.42.42.5(pid=20054) [trial-2357↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=20063): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20063) [trial-2357↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20063)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=20073): Process ended prematurely: osmo-stp_10.42.42.5(pid=20073) [trial-2357↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20073)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20087): Process ended prematurely: osmo-stp_10.42.42.5(pid=20087) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20087)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20098): Process ended prematurely: osmo-stp_10.42.42.5(pid=20098) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20098)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20112): Process ended prematurely: osmo-stp_10.42.42.5(pid=20112) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20112)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20123): Process ended prematurely: osmo-stp_10.42.42.5(pid=20123) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20123)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20140): Process ended prematurely: osmo-stp_10.42.42.5(pid=20140) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20140)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20151): Process ended prematurely: osmo-stp_10.42.42.5(pid=20151) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20151)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20165): Process ended prematurely: osmo-stp_10.42.42.5(pid=20165) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20165)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20176): Process ended prematurely: osmo-stp_10.42.42.5(pid=20176) [trial-2357↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20176)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20190): Process ended prematurely: osmo-stp_10.42.42.5(pid=20190) [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20190)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20201): Process ended prematurely: osmo-stp_10.42.42.5(pid=20201) [trial-2357↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20201)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20216): Process ended prematurely: osmo-stp_10.42.42.5(pid=20216) [trial-2357↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20216)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20227): Process ended prematurely: osmo-stp_10.42.42.5(pid=20227) [trial-2357↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20227)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20245): Process ended prematurely: osmo-stp_10.42.42.5(pid=20245) [trial-2357↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20245)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20257): Process ended prematurely: osmo-stp_10.42.42.5(pid=20257) [trial-2357↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20257)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=20275): Process ended prematurely: osmo-stp_10.42.42.5(pid=20275) [trial-2357↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20275)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20286): Process ended prematurely: osmo-stp_10.42.42.5(pid=20286) [trial-2357↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20286)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20296): Process ended prematurely: osmo-stp_10.42.42.5(pid=20296) [trial-2357↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20296)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20315): Process ended prematurely: osmo-stp_10.42.42.5(pid=20315) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20315)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20331): Process ended prematurely: osmo-stp_10.42.42.5(pid=20331) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20331)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=20349): Process ended prematurely: osmo-stp_10.42.42.5(pid=20349) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20349)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20359): Process ended prematurely: osmo-stp_10.42.42.5(pid=20359) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20359)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20369): Process ended prematurely: osmo-stp_10.42.42.5(pid=20369) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20369)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20388): Process ended prematurely: osmo-stp_10.42.42.5(pid=20388) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20388)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20401): Process ended prematurely: osmo-stp_10.42.42.5(pid=20401) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=20419): Process ended prematurely: osmo-stp_10.42.42.5(pid=20419) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20419)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20429): Process ended prematurely: osmo-stp_10.42.42.5(pid=20429) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20429)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20439): Process ended prematurely: osmo-stp_10.42.42.5(pid=20439) [trial-2357↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20439)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20454): Process ended prematurely: osmo-stp_10.42.42.5(pid=20454) [trial-2357↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20454)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20467): Process ended prematurely: osmo-stp_10.42.42.5(pid=20467) [trial-2357↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20467)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20476): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20476) [trial-2357↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20476)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=20486): Process ended prematurely: osmo-stp_10.42.42.5(pid=20486) [trial-2357↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20486)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20503): Process ended prematurely: osmo-stp_10.42.42.5(pid=20503) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20503)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20514): Process ended prematurely: osmo-stp_10.42.42.5(pid=20514) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20514)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20528): Process ended prematurely: osmo-stp_10.42.42.5(pid=20528) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20528)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20539): Process ended prematurely: osmo-stp_10.42.42.5(pid=20539) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20539)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20553): Process ended prematurely: osmo-stp_10.42.42.5(pid=20553) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20553)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20564): Process ended prematurely: osmo-stp_10.42.42.5(pid=20564) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20564)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20578): Process ended prematurely: osmo-stp_10.42.42.5(pid=20578) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20578)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20589): Process ended prematurely: osmo-stp_10.42.42.5(pid=20589) [trial-2357↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20589)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20604): Process ended prematurely: osmo-stp_10.42.42.5(pid=20604) [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20604)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20616): Process ended prematurely: osmo-stp_10.42.42.5(pid=20616) [trial-2357↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20616)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20630): Process ended prematurely: osmo-stp_10.42.42.5(pid=20630) [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20630)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20641): Process ended prematurely: osmo-stp_10.42.42.5(pid=20641) [trial-2357↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20641)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20655): Process ended prematurely: osmo-stp_10.42.42.5(pid=20655) [trial-2357↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20666): Process ended prematurely: osmo-stp_10.42.42.5(pid=20666) [trial-2357↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20666)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=20684): Process ended prematurely: osmo-stp_10.42.42.5(pid=20684) [trial-2357↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20684)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20699): Process ended prematurely: osmo-stp_10.42.42.5(pid=20699) [trial-2357↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20699)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20718): Process ended prematurely: osmo-stp_10.42.42.5(pid=20718) [trial-2357↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20718)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20728): Process ended prematurely: osmo-stp_10.42.42.5(pid=20728) [trial-2357↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20728)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20738): Process ended prematurely: osmo-stp_10.42.42.5(pid=20738) [trial-2357↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20756): Process ended prematurely: osmo-stp_10.42.42.5(pid=20756) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20756)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20768): Process ended prematurely: osmo-stp_10.42.42.5(pid=20768) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20768)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=20786): Process ended prematurely: osmo-stp_10.42.42.5(pid=20786) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20786)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20796): Process ended prematurely: osmo-stp_10.42.42.5(pid=20796) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20796)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20806): Process ended prematurely: osmo-stp_10.42.42.5(pid=20806) [trial-2357↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20806)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20823): Process ended prematurely: osmo-stp_10.42.42.5(pid=20823) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20823)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=20835): Process ended prematurely: osmo-stp_10.42.42.5(pid=20835) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20835)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20856): Process ended prematurely: osmo-stp_10.42.42.5(pid=20856) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20856)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20867): Process ended prematurely: osmo-stp_10.42.42.5(pid=20867) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20867)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20877): Process ended prematurely: osmo-stp_10.42.42.5(pid=20877) [trial-2357↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20877)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=20894): Process ended prematurely: osmo-stp_10.42.42.5(pid=20894) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20894)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20906): Process ended prematurely: osmo-stp_10.42.42.5(pid=20906) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20906)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20925): Process ended prematurely: osmo-stp_10.42.42.5(pid=20925) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20925)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20935): Process ended prematurely: osmo-stp_10.42.42.5(pid=20935) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20935)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20945): Process ended prematurely: osmo-stp_10.42.42.5(pid=20945) [trial-2357↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20945)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20958): Process ended prematurely: osmo-stp_10.42.42.5(pid=20958) [trial-2357↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20958)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=20968): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20968) [trial-2357↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20968)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=20970): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20970) [trial-2357↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20970)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=20972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20972) [trial-2357↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20972)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20974): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20974) [trial-2357↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20974)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=20984): Process ended prematurely: osmo-hlr_10.42.42.2(pid=20984) [trial-2357↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20984)] FAIL: esme_connect_policy_closed.py (6.4 sec) Error: osmo-hlr_10.42.42.2(pid=20995): Process ended prematurely: osmo-hlr_10.42.42.2(pid=20995) [trial-2357↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20995)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21007): Process ended prematurely: osmo-stp_10.42.42.5(pid=21007) [trial-2357↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21007)] FAIL: esme_ms_sms_transaction.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21018): Process ended prematurely: osmo-stp_10.42.42.5(pid=21018) [trial-2357↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21018)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21032): Process ended prematurely: osmo-stp_10.42.42.5(pid=21032) [trial-2357↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21032)] FAIL: register_a5_0_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21043): Process ended prematurely: osmo-stp_10.42.42.5(pid=21043) [trial-2357↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21043)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21054): Process ended prematurely: osmo-stp_10.42.42.5(pid=21054) [trial-2357↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21054)] FAIL: register_a5_3_authreq.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21335): Process ended prematurely: osmo-stp_10.42.42.5(pid=21335) [trial-2357↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21335)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.9 sec) Error: srsepc(pid=21357): Process ended prematurely: srsepc(pid=21357) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21357)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=21373): Process ended prematurely: srsepc(pid=21373) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21373)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=21390): Process ended prematurely: srsepc(pid=21390) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21390)] FAIL: iperf3_ul.py (19.0 sec) Error: srsepc(pid=21406): Process ended prematurely: srsepc(pid=21406) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21406)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=21422): Process ended prematurely: srsepc(pid=21422) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21422)] FAIL: rrc_idle_mo_ping.py (18.3 sec) Error: srsepc(pid=21441): Process ended prematurely: srsepc(pid=21441) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21441)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=21457): Process ended prematurely: srsepc(pid=21457) [trial-2357↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=21457)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21472): Process ended prematurely: osmo-stp_10.42.42.5(pid=21472) [trial-2357↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21487): Process ended prematurely: osmo-stp_10.42.42.5(pid=21487) [trial-2357↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21487)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21501): Process ended prematurely: osmo-stp_10.42.42.5(pid=21501) [trial-2357↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21501)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21522): Process ended prematurely: osmo-stp_10.42.42.5(pid=21522) [trial-2357↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21522)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21536): Process ended prematurely: osmo-stp_10.42.42.5(pid=21536) [trial-2357↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21536)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21550): Process ended prematurely: osmo-stp_10.42.42.5(pid=21550) [trial-2357↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21564): Process ended prematurely: osmo-stp_10.42.42.5(pid=21564) [trial-2357↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21564)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21579): Process ended prematurely: osmo-stp_10.42.42.5(pid=21579) [trial-2357↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21579)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21595): Process ended prematurely: osmo-stp_10.42.42.5(pid=21595) [trial-2357↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21595)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21609): Process ended prematurely: osmo-stp_10.42.42.5(pid=21609) [trial-2357↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21609)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21623): Process ended prematurely: osmo-stp_10.42.42.5(pid=21623) [trial-2357↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21623)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21637): Process ended prematurely: osmo-stp_10.42.42.5(pid=21637) [trial-2357↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21637)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21651): Process ended prematurely: osmo-stp_10.42.42.5(pid=21651) [trial-2357↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21651)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21665): Process ended prematurely: osmo-stp_10.42.42.5(pid=21665) [trial-2357↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21665)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21679): Process ended prematurely: osmo-stp_10.42.42.5(pid=21679) [trial-2357↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21679)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21693): Process ended prematurely: osmo-stp_10.42.42.5(pid=21693) [trial-2357↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21693)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21707): Process ended prematurely: osmo-stp_10.42.42.5(pid=21707) [trial-2357↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21707)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21721): Process ended prematurely: osmo-stp_10.42.42.5(pid=21721) [trial-2357↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21721)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21736): Process ended prematurely: osmo-stp_10.42.42.5(pid=21736) [trial-2357↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21736)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21750): Process ended prematurely: osmo-stp_10.42.42.5(pid=21750) [trial-2357↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21750)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=21764): Process ended prematurely: osmo-stp_10.42.42.5(pid=21764) [trial-2357↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21764)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21778): Process ended prematurely: osmo-stp_10.42.42.5(pid=21778) [trial-2357↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21778)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21792): Process ended prematurely: osmo-stp_10.42.42.5(pid=21792) [trial-2357↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21792)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21809): Process ended prematurely: osmo-stp_10.42.42.5(pid=21809) [trial-2357↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21809)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21823): Process ended prematurely: osmo-stp_10.42.42.5(pid=21823) [trial-2357↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21823)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21837): Process ended prematurely: osmo-stp_10.42.42.5(pid=21837) [trial-2357↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21852): Process ended prematurely: osmo-stp_10.42.42.5(pid=21852) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21852)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21867): Process ended prematurely: osmo-stp_10.42.42.5(pid=21867) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21895): Process ended prematurely: osmo-stp_10.42.42.5(pid=21895) [trial-2357↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21895)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21909): Process ended prematurely: osmo-stp_10.42.42.5(pid=21909) [trial-2357↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21909)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21923): Process ended prematurely: osmo-stp_10.42.42.5(pid=21923) [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21923)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21937): Process ended prematurely: osmo-stp_10.42.42.5(pid=21937) [trial-2357↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21937)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21951): Process ended prematurely: osmo-stp_10.42.42.5(pid=21951) [trial-2357↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21951)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21965): Process ended prematurely: osmo-stp_10.42.42.5(pid=21965) [trial-2357↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21965)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21979): Process ended prematurely: osmo-stp_10.42.42.5(pid=21979) [trial-2357↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21979)] + rm -rf trial-2357/inst + cd trial-2357 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 08:22:30 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357-run.tgz run.2022-12-09_08-22-41 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2357-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17652.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2946.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29258.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3906.tgz osmo-pcu-sysmo.build-5188.tgz osmo-pcu.build-5149.tgz osmo-sgsn.build-30033.tgz osmo-stp.build-9238.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE